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I. INTRODUCTION 

The most powerful method for studying one-dimensional gapped quantum spin systems is 
without doubt the density matrix renormalization groupP^'^. The density matrix renormal- 
ization group can be interpreted as a variational method that selects the best approximation 
to the true ground state of the system within the set of states known as matrix product 
state^^^'^. The history of matrix product states dates back to before the development 
of the density matrix renormalization group, when they were referred to as valence bond 
stateP'^'^MZl or finitely correlated state^^^*^. In fact, related constructions were already 
developed in the study of classical statistical mechanics a few decades agd^'^. 

The development of matrix product states benefited greatly from insights regarding en- 
tanglement that were being formulated within the field of quantum information theory. This 
resulted in new algorithms for studying systems with periodic boundary conditiond^, time 
evolutioi j^^ * ^^ * ^^ * ^^ and for systems at finite temperature or with dissipative dynamic^^^'^. In 
addition, the basic structure of the matrix product state was generalized to more arbitrary 
networks of contracted tensors, in order to cope with different settings. Specific examples 
include the multiscale entanglement renormalization ansat'^^ for critical systems, or the 
projected entangled-pair states for higher-dimensional systemd^^ESESl. 

So far, most studies focussed on the physical properties of these states. The mathematical 
and geometric properties of the whole set of matrix product states with a fixed bond dimen- 
sion have so far received less attention. Recently, however, new algorithms for simulating 
time-evolutioiJ^ and for studying excitation spectraP^'^ were developed that inherently de- 
pend on the tangent space to the set of matrix product states. However, such an approach is 
only justified if we can identify this set as a smooth manifold embedded in the total Hilbert 
space of quantum states. The purpose of this paper is to make this identification and elabo- 
rate on many of the details behind the construction lying at the heart of the aforementioned 
algorithms. We do not discuss the algorithms themselves. The current paper restricts to the 
identification of the matrix product state construction as a principal fiber bundle, followed 
by a discussion of the differential geometric properties of its base manifold (the set of states 
in Hilbert space). A more detailed presentation of the aforementioned algorithms including 
the relationship between them is given elsewher^^. 

The first section of this paper introduces standard concepts from differential geometry 
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applied to the case of a variational manifold, i.e. a set of quantum states {"^{z)) — depending 
on some complex variational parameters z^, i = l,...,m — that is assumed to form a 
smooth manifold embedded in the total Hilbert space EI of the problem. We also discuss 
the geometric properties of Hilbert space itself, and give a brief summary of the theory 
of complex manifolds. In the second section we study generic matrix product states with 
open boundary conditions. We discuss the conditions that need to be imposed in order to 
identify the matrix product state representation as a principal fiber bundle, from which we 
can derive that the resulting set of physical states is a smooth manifold, more specifically 
a Kahler manifold, using standard tools from (complex) differential geometry. The same 
construction is repeated in the third section for the case of uniform matrix product states 
with periodic boundary conditions, which requires some non-trivial modifications. These are 
the main results of this paper. Having a differential structure, we then go on in both sections 
by introducing tangent vectors to the manifold of physical states. The parameterization 
thereof requires the introduction of a principal bundle connection, which can be fine-tuned 
in order to simplify the induced Hilbert space metric. This was one of the main results used 
in the aforementioned algorithms. Finally, we complete the geometric description of the 
manifold of matrix product states by also deriving the Levi-Civita connection and Riemann 
curvature tensor for this manifold. 

Identical tensor network decompositions for higher-order tensors have been independently 
developed in the field of applied mathematics. The main interest there is on the matrix prod- 
uct structure (tensor train decomposition)!^ and on the tree-tensor structure (hierarchical 
Tucker format )ff^. Only this year was it proven that the set of states defined by these formats 
does indeed constitute a smooth manifolcP^'^ using techniques similar to ours. The present 
paper deviates from previous results as quantum states live in a complex rather than a real 
vector space. Secondly, we allow for matrix product states with periodic boundary condi- 
tions. In general, loops in a tensor network have to be treated carefully because the resulting 
set of states might not be closecP^. Therefore, they have not been considered in aforemen- 
tioned papers. In addition, we have a natural geometry induced from the Hilbert space 
in which these manifolds are embedded, which allows us to define a metric, a Levi-Civita 
connection and a Riemann curvature tensor. 

Finally, we would also like to draw attention to the work of Sidles et al.^, where varia- 
tional classes of quantum states multilinear in the variational parameters were also recog- 
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nized as Kahler manifolds. Generic matrix product states — and in fact more general tensor 
networks — do indeed fulfill this multilinearity property. However, the translation-invariant 
uniform matrix product states of Section IV do not. Sidles et al.^ does not discuss the 
principal fiber bundle structure and the corresponding principal bundle connection, which is 
considered a key result of the current manuscript. However, Ref. [50] discusses in great detail 
the curvature properties of these manifolds and the physical relevance thereof, in particular 
in relation to the error resulting from approximating arbitrary quantum states within the 
variational set. As such. Sidles et al. can be considered complementary to our manuscript, 
and we only provide a brief discussion of the curvature properties for the case of uniform 



matrix product states in Subsection IV F 



II. VARIATIONAL MANIFOLDS AS KAHLER MANIFOLDS 



The state of an isolated quantum system is described by a vector |^) living in a Hilbert 
space H. If the dimension of the Hilbert space is too large to be handled numerically, 
one often resorts to variational classes of quantum states, i.e. subsets of EI that hopefully 
contain a good approximation to the physically interesting states of the problem. While it 
is possible to construct variational classes that are subspaces, there are many interesting 
classes for which the vector space structure is lost in the variational subset. However, 
the way in which the variational class is constructed often suggests that the variational 
subset can still be given the structure of a smooth manifold to which we can induce the 
geometric properties of the underlying Hilbert space. Under general conditions which are 



discussed in the Subsection II C the subset will be a complex manifold, or to be even more 
specific, a Kahler manifold, and a beautiful new structure becomes available to study the 
approximated quantum problem within the variational manifold, which is further explored 
in the third and fourth subsection. As complex differential geometry might not be part of 
the standard toolbox of our target audience, we provide a very concise introduction to the 



subject in Subsection II A, by reviewing the minimal set of definitions required to understand 



the remainder of this paper. 
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A. Crash course in complex geometry 

This subsection mainly serves to introduce notation, and we refer to many excellent 
references for a more detailed treatment of the theory of complex manifolds and proofs 
for the corresponding theorems and lemma^^^'^HMl jj^ particular, we follow the notation 
convention of Ref. |3ll 

Definition 1 (Complex manifold). A topological space is a complex manifold of complex 
dimension m if 

(i) Al is provided with an atlas i.e. a family of charts {Ui,(j)i), where {Ui} is 
a family of open sets that covers Al and 0j is a homeomorphism from Ui to an open 
subset of C"". 

(ii) Given Ui and Uj such that UiDUj ^ 0, the transition map ipij = (pjocf)'^ from (jyiiUiPdAj) 
to nWj) is holomorphic, i.e. the limit 

z->zo Z — Zq 

exists for every Zq E (piiUi HUj). 

Henceforth, we always refer to the complex dimension of any manifold we encounter and 
denote it as dimAl = dimcAl. The corresponding real dimension is twice the complex 
dimension and is denoted as dimuAl = 2dimcAl. Clearly, the most elementary complex 
manifold is itself. 

Definition 2 (Holomorphic map). Let / : Al — A/" be a continuous map between two 
complex manifolds Al and A" with respective (complex) dimensions m and n and respective 
atlases {(Ui,(j)i)} and {{yj,ipj)}. Define the open sets Uij = U fl f'^iVj) with f'^iVj) the 
preimage of Vj. The map / is called holomorphic if the n components of ipjO f o : — )■ 
C" are holomorphic in any of the m variables in the open subset (f)i{Uij) C C™. 

If / is injective and surjective, then / is also a diffeomorphism and it is called a biholo- 
morphism because its inverse : A/" — > Al is also holomorphic. Correspondingly, the 
complex manifolds Al and A/" are said to be biholomorphic. 

For any smooth manifold Al, the tangent space TpAl at a point p G Al is the vector 
space of all directional derivatives of functions / : Al — t- M at the point p. For a complex 
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manifold Ai with dimA^ = m, TpAi is a real vector space with real dimension 2m and a 
basis is given by the partial derivatives 



The dual space or cotangent space T*Jli is spanned by the basis vectors 

{(da:i)^,...,(da:-)^;(dyi)^,...,(dy-)J, 

which satisfy 



(1) 



An almost complex structure Jp is introduced as a smooth (real) tensor field Jp : TpM. — )■ 
TpM. via the prescription 

This definition does not depend on the chosen coordinate map for complex manifolds Ai. 
Note that = -idx^^M- 

By also considering complex-valued functions / : — )■ C, it becomes useful to study the 
complexified tangent space. The complexified vector space TpM!^ is obtained by extending 
the vector space to all complex linear combinations of the basis vectors (see^^ for a more 
rigorous definition). It is a complex vector space with complex dimension 2m. A new basis 
{{dj)p, (9j)p}j=i^...^m for TpA^^ is obtained by defining 

The use of barrred indices for the complex conjugate variables will become clear when 
introducing a metric at the end of this subsection. Analogously, a complexified dual space 
{TpM.'^)* = {T*M.)'^ is introduced and the corresponding basis {(d^;-')^; (d^;"')^} is defined 
by 

dz^ = dx^ + idy^ , dz' = dx-^ — idy^ . (4) 
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In these new bases, the almost complex structure J is given as the tensor field 



j, = i(d^^)^0(a,)^-i(d/)^®(aj) 



(5) 



so that its matrix representation is diagonal. The complexified tangent space TpAi is 
decomposed into two sectors TpAi"^ corresponding to the eigenspaces of Jp with eigenvalue 
±i. The holomorphic tangent space TpM.'^ is a complex vector space with complex dimension 
m and is thus isomorphic to C"*. It is spanned by {{dj)p}j=i^„_^rn and corresponds to those 
directional derivatives that annihilate anti-holomorphic functions / : — > C. Similarly, 
the anti-holomorphic tangent space TpAi^ is spanned by {(9j)p}j=i,...,„t and annihilates 
holomorphic functions / : — > C. By extending these definitions to the whole tangent 
bundle TA4, the holomorphic and anti-holomorphic tangent bundles TM."^ are obtained so 
that TM^ = TM+ TM-. 

The following two lemmas are used throughout this paper. 

Lemma 1. Let M. he a complex manifold with dimA4 = m and with atlas {{Ui,(j)i)}. Any 
open subset M of M. is a complex manifold with dimj'V^ = dim and atlas {{UinAf, (f)i)}. In 
addition, the tangent space TpJ\f , complexified tangent space TpAf^ and (anti-)holomorphic 
tangent space TpM"^ equal the corresponding tangent spaces TpM., TpM.^ and TpM."^ for any 



Lemma 2. The Cartesian product A4 x J\f of two complex manifolds M. and H with 
dim = m and dimjV — n, is a complex manifold with dim x J\f — m + n. 

Next, we can endow a complex manifold with a metric. 

Definition 3 (Hermitian metric). Let the complex manifold Ai have a Riemannian metric 
G, i.e. for every p & Ai, Gp is a symmetric positive-definite bilinear form on the real vector 
space TpM.. Due to its hnearity, it can trivially be extended to TpM'^. If Gp{JpX, JpY) — 
Gp{X,Y) for every X,Y e TpM.'^ and every p E Ai, then G is called a Hermitian metric 
and is a Hermitian manifold. 

Having a set of complex coordinates z e C"^ for M., it can easily be checked that a 
Hermitian metric G is of the form 



peX. 



G — gij{z, z)dz^ <S> dz^ + gzj{z, z)dz ® dz^ 



(6) 



8 



Geometry of Matrix Product States 

with Qij — g-ji due to the symmetry property of the Riemannian metric and gij — 0, gjj — 0. 
In addition, we have that gij — g]^. A Hermitian metric Gp ai p & A4 defines an inner 
product — a positive-definite Hermitian form — gp on TpM.'^ by 

gp-. TpM+ X TpM+ ^ C: (X,y) ^ 9piX,Y) = Gp{X,Y). (7) 

Note that Y e TpM.~. If (9j)p is chosen as basis for TpM.'^, the matrix notation for gp is 
(yfj j, i.e. gp{X, Y) = Y^g^jXK Vice versa, any inner product gp on TpAi'^ defines a Hermitian 
metric G. Note that standard notation is g for the full Riemannian metric of TpM!^ and h 
for the Hermitian inner product on TpAi^. We do not adhere to this convention because h 
typically represents a Hamiltonian (density) in the quantum literature, which would result 
in a source of confusion. In addition, as explained in the next subsection, we are mainly 
interested in the elements of TpAi'^ throughout the remainder of this paper, and simply 
refer to g as representing the metric. As noted, g completely determines the full Hermitian 
metric G. 

If is a Hermitian manifold with Hermitian metric G, the Kdhler form of G is defined 
as the 2-form fl with prescription 

Qp-. TpM^ X TpM^ ^C:{X,Y)^ Y) = Gp{JpX, Y). (8) 

In coordinates z G C™, the 2-form Q is given by 0. = igijdz^ A dz'' and can seen to be real 
{fl — fl). An interesting subclass of Hermitian manifolds are the so-called Kdhler manifolds. 

Definition 4 (Kahler manifold). Let be a Hermitian manifold with Hermitian metric G 
and corresponding Kahler form Q. The manifold is a Kahler manifold if Q is closed, i.e. 
dQ — 0. The corresponding metric is called a Kahler metric. 

In coordinates z e C"*, a Kahler manifold satisfies dig^j^ — and dig^j^ — 0. Locally, this 
implies the existence of a Kdhler potential K{z, z) such that 

gij{z, z) = didjK{z, z) . (9) 

By also defining the inverse metric such that 

g'^^iz, z)gjk{z, z) = 4, g,j{z, z)g^^{z, z) = Sl (10) 
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one can easily derive the Levi-Civita connection. The only non- vanishing components of the 
connection are given by 

r,/(z, z) = g'^^iz, z)dig^j{z, z) = ^'^l^, z)d^d,d^K{z, z), ^^^^ 
r^\z, z) = /-(z, z%g,m{z, z) = g^^{z, z)dmd,djKiz, z). 

Because the Levi-Civita connection has no non-zero mixed components, the Riemannian 
geometry of Kahler manifolds is compatible with the complex structure, i.e. holomorphic 
tangent vectors X e are parallel transported into holomorphic tangent vectors. Fi- 

nally, the only non-zero components of the Riemann tensor are 

- d-,didjduK{z, z) - {djdjd„,Kiz, z))(?"^(z, z){didndkK{z, z)) (12) 
= djdig-i^iz, z) - r^^'^(z, z)yyfi„(z, z)r.fc"(z, z) 

in combination with 

As a final topic of this introduction, we introduce the concept of a complex Lie group 

Definition 5 (Complex Lie Group). A complex Lie group G is a Lie group G that has the 
structure of a complex manifold and for which the group operations of multiplication 

G X G ^ G : (Gi, G2) ^ G1G2 (14) 

and taking the inverse 

G^G-.G^Q-^ (15) 

are holomorphic maps. 

Clearly, the complex general linear group GL(D, C) of invertible complex D x D matri- 
ces is a complex Lie group with complex dimension dimGL(D, C) = D^. Unlike the real 
general linear group GL(£),R), the complex case GL(£),C) is connected. We conclude this 
introductory review with another lemma. 

Lemma 3. The direct product group Gi x G2 of two complex Lie groups Gi and G2 is a 
complex Lie group with dim Gi x G2 = dim Gi -|- dim G2. 
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B. Complex geometry of Hilbert space 

This paper is concerned with the study of quantum systems, the state of which is described 
by a vector in some Hilbert space H. By introducing a basis {|ei)}j=i,...,dimH in a finite- 
dimensional Hilbert space H and identifying states \^) — z'^ \ei) e H with z e C^™''^, we 
obtain a biholomorphism between EI and the complex Euclidean space C**™''^. Alternatively, 
we can interpret the relation between l^') and z as a globally defined coordinate chart, by 
which EI satisfies the conditions for being a complex manifold. 

Physically interesting functions on H are of the form 



(16) 



or the normalized version 



(17) 



If 1^) = \e,i} and |$) = \e,i) with z,w E ^dimM^ then the action of the holomorphic 
tangent vector (di)^^^ on fo is given by 

(a,)|^)/o = (^|0|$). 

Consequently, we can identify w*(9j)|^) e Tj^)EI+ with |$) e H for any base point 1^^) e H. 
We thus conclude that T],i,)EI+ = EI for any |^) G EI. A similar argument shows that 
Tj^^EI" = EI*. From this identification, T|^^EI^ can be endowed with a natural inner product 



^fj) : e X H ^ C: (|<|.i) , |$2)) ^ <?[;/(!$ i) , 1$ 2)) = ($2|$i) 



(18) 



the matrix elements of which are given by 



9zj -9n - {ei\ej), 



(19) 



with (cjI the linear functional associated to the basis vector |ej) according to the Riesz 
representation theorem. In case of an orthonormal basis, the full Riemannian metric G^^^ 
for the tangent space Tj$)EI'^ reduces to 



dim I 



i=l 



^(H) 



1 

1 



(20) 
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with i the identity operator on H. Clearly, EI is globally flat and the Levi-Civita connection 
and Riemann curvature tensor vanish everywhere. In particular, it is Kahler manifold with 
K{z,z) = {^\^) = z'g,jZ^. 

While it is common practice to study quantum mechanics using state vectors in affine 
Hilbert space H, physical states correspond to rays of such vectors and should be identified 
with the elements of the projective Hilbert space P{M) = e/GL(l,C) = CP'^''^^-\ Here, 
GL(1, C) is the multiplicative abelian group of norm and phase changes which acts on EI as 

T-.Mx GL(1,C) ^H: (|^),A) ^ r(|^) ,A) = A |^) . (21) 



Indeed, physical results are related to normalized expectation values fo as in Eq. (17), which 
is invariant under the action of GL(1,C) and can thus be restricted to P(EI). While it is 
often easier to work in the affine space EI, it turns out that using the projective structure of 
state space is required when studying uniform matrix product states in the thermodynamic 
limit, in order to avoid a number of unpleasant divergences. 

The ray of states containing a vector |\E') G EI is denoted as [|^)] G P(EI). However, in all 
calculations, we denote the elements [|^)] G P(EI) using any representative |\E'') = A of 
the ray [|^)] and consider these as a set of homogeneous coordinates for the elements of P(IHI), 
rather than trying to define a new set of stereographic or orthographic coordinates which 
are not globally well defined. Often, formulas greatly simplify when choosing a normalized 
representative, i.e. (\I''|\I'') = 1. 

The tangent space r[|^)]P(EI) is the quotient vector space T|,j)EI/ ~ = EI/ ~, where two 
vectors |$i) , |$2) G H are equivalent (|<I>i) ~ |$2)) if |$i)-|$2) = a |\I') for some a G C. We 
can find a unique representative |$) G EI for every tangent vector in T[|,j,)]P(EI) by imposing 
a condition such as 

(^1$) = 0, (22) 

and we obtain T[|^)]P(EI) = Elj^^, where Elj^^ is the orthogonal complement of the one- 
dimensional subspace spanned by |\E'). A representation |$) that does not satisfy this con- 
dition can be transformed into one that does by acting with 

= 1 - = 1 - (23) 

the orthogonal projector onto Elj^^. Projective Hilbert space P(EI) is still a Kahler manifold 
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if one endows it with the Fubini-Study metric g'^'^^ for T[\q,)]P{M.)^ , which is defined ad^^l 

^1^^ , |$2)) - ^^^2 - (vl;|vl;) • ^24) 

The Fubini-Study metric corresponds to the infinitesimal version of the normahzed overlap 
{'^l'^') /((\['|vl/) (vI/'|vl/'))i/2 Qf quantum states. Note that, using representations |$i,2) 



that satisfy Eq. (22) and a base point representation |\E') satisfying (^E'l^E') = 1, the Fubini- 
Study metric reduces to the ordinary metric g^^y In terms of the homogeneous coordinates 
|\E'), the corresponding Kahler potential is given by = log = log (^E'l^E^). 

Henceforth, we are most interested in the physical states living in the holomorphic tangent 
space. Often, we fail to mention the restriction to the holomorphic part and just refer 
to this as the tangent space containing tangent vectors. For submanifolds Ai G M., the 
(holomorphic) tangent space at some point |\E') G Ai satisfies T\^)Ai^ C H, and we always 
denote (holomorphic) tangent vectors of complex submanifolds C EI as vectors | ) G H, 
rather than as a directional derivatives. While the latter is the standard approach in modern 
differential geometry and allows one to study the manifold intrinsically, the former facilitates 
a geometric interpretation of our results, making them (hopefully) more accessible to people 
with less background in differential geometry. 



C. Complex variational manifolds 

For many interesting systems, the dimension of the Hilbert space is too large to allow for 
an exact solution, neither analytically nor numerically. One powerful approach to obtain 
approximate results is by restricting to a set of variational ansatz states |^E'(2)) depending on 
a number of parameters z"^ with i = 1, . . . ,m where typically m <^ dim EI so that this set is 
easier to handle. Throughout this paper, we restrict to ansatzes \E' for which the parameters 
z can take complex values in some open subset U of C™, either directly or via analytic 
continuation. Furthermore, we impose the additional restriction that the map : W — )■ EI 
is holomorphic. 

Definition 6 (Variational subset). The variational subset M corresponding to a variational 
ansatz ^ -.U C C™ — )■ EI is defined as the image of \E', that is 

M = ^{U) = {\^!{z))\z eU}. (25) 
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The restriction to holomorphic maps \I/ is not sufficient to give any differentiable structure 
to Ai. Without further conditions on \E', we can not conclude that the variational subset is 
a manifold, e.g. we cannot exclude the possibility that Ai intersects itself. Throughout the 
remainder of this section, we assume that \I' is injective, so that Ai is biholomorphic to the 
complex manifold U (see Lemma [T| and is therefore an embedded complex submanifold of 
H. 

Under the injectivity assumption, a holomorphic inverse map : Ai G C" can be 
defined, so that {Ai, \E'~^) can be interpreted as a global coordinate chart for At. However, 
we refrain from doing so, since the injectivity restriction on \1' will be lifted in the next 
section, in which case we no longer have a coordinate chart \E'~^. 

With a slight abuse of notation, we use the same symbol to denote the associated 
antiholomorphic map \E': W — H* : z i— )■ (^'(z)!, with M* the dual space of linear func- 
tional on H. We explicitly denote the antiholomorphic dependence of the bras on the 
variational parameters. For the holomorphic map \E': W — )■ Ai, we also define the tan- 
gent map d*^: T,W+ T\^{z))M+ with r^W+ = {TX"")^ = C™ (see Lemma |l[ and 
T\q,(z))Ai^ C T|^(;j;))EI+ = H. We define a pushforward d\E'^(w* di\^) of tangent vectors 

di\^ G (T^C'")^ to the holomorphic tangent space (T\,^(^z))At)^ C H. For the partial 
derivatives of at a point z eU, we introduce the notation 

di-^ : U ^ M: z ^ \di-^{z)) = di |^(2))|^. (26) 

The tangent map d'^z is then given by the prescription 

d^,: ^ T\^iz))M+ C H: w\di)z ^ w' m{z)) ^ Mw; z)) , (27) 

which defines a new map $ : C"^ x C" — )■ H. Finally, we also define the holomorphic tangent 
bundle TAi^ C = EI x H. The pushforward of \I' induces a bundle map, i.e. a map 

between between the tangent bundles TU~^ = C"^ x U and TAi^ C EI x H, which acts as 

d^: xU ^TM^: {w'z) ^ (|$(i(;; 2)) ; |^(z))). (28) 
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D. Metric, connection and curvature in afRne Hilbert space 

We can induce the standard Hilbert metric onto Ai and then define a pullback metric 
g = "^*g^^^ that is given by 

g,:C^x ^ C: {w,,w,) ^ g.{w,,W2) = ^?fJJ,)^(d^.K), d^,(w;2)). (29) 

We can further simphfy gz{wi, W2) as 

gz{Wi,W2) = {^{W2;z)\^iwi; z)) = wl{d,^{z)\dj<il{z)) w{. 

We now switch to a coordinate-based notation, and define the entries of the Hermitian metric 
as 

g,,{z,z) = (d,^{z)\d,^{z)), (30) 

which is indeed Hermitian [g^j = gj^) and positive definite, due to the injectivity of \[^. Note 
that we still use the term pullback metric when the injectivity of \E' is abandoned and g 
can become degenerate. At that point, the pullback metric g is no longer a proper metric 
according to the strict definition. We discuss the consequences when encountering this issue 
for the first time in the next subsection. It can be checked that in combination with the 



metric g defined in Eq. (29), is a Kahler manifold with Kahler potential K{z,z) = 
N{z,z), with N{z,z) = (^(2)1^(2)) the norm function. Indeed, it was shown that any 
complex submanifold of a Kahler manifold is also a Kahler manifolcP^. We define an inverse 
metric with nonzero entries g^^{z,z) = g^^{z,z) such that g"^^ [z , z) gjk{z , z) = 5*^ and can 



then easily derive the Levi-Civita connection using the results from Subsection II A The 
only non-vanishing components of the connection are given by 

r,/ = (B^mdj'^) , V = 9""' (dA^\dm^) , (31) 

where we have omitted the arguments z and z for the sake of brevity. Similarly, the only 
non-zero components of the Riemann tensor are 

Ri-jki = {djdj^ldA'^) - (^-^-^\d^^ g^^ (^^%d,d^^) (32) 



in combination with the symmetries in Eq. (13). 
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E. Metric, connection and curvature in projective Hilbert space 

When trying to associate a manifold Ai C P{M.) to the original manifold M. gM., there 
are a number of possibilities depending on the nature of Ai, and thus on the nature of the 
map \E'. Even if the variational subset Ai is guaranteed to be a manifold, this does not 
automatically imply that there are no singularities or self-intersections in the set 

M = {[\^{z))]yzeU}. (33) 

We now assume that the map \1/ is sufficiently regular in order to be able to define as a 
complex manifold for some open domain U of the parameter space. 
For example, if the map \1/ satisfies 

yz G W, VA G C: A |^(z)) G ^ A = 1, 

so that Ai contains at most a single representative on every ray of vectors in H, then we 
can immediately define a map \E' : W — P(M.) by setting 

^ : W ^ P(e) : z ^ [1^(2))] (34) 

with [|\E'(2))] G P{M.) the ray to which |^I^(2)) belongs. The map is still injective and we 
can induce the Fubini-Study metric onto Ai and define a positive definite puUback metric 
g on U. 

Alternatively, it could be the case that Ai contains parts of rays of vectors, such that 

Vz G W, 3e^ > : a G B,^ (0) e" \^{z)) G M (35) 

with -Be(O) = {a G C||a;| < e}. A particular subcase of this type is when the map \l/ satisfies 
|^(A2)) = /(A) |\l'(z)) for any A G GL(1,C) for which Xz G U, where / is necessarily 
holomorphic. In that case we could define an injective map from P{U) C CP™^^ — )■ P{M.) 
that equals \1/ when expressed in terms of homogeneous coordinates for both projective 
spaces. However, from a practical point of view it is more convenient to have a parameter 
space with an affine structure, and to work with the map W — ?■ P(EI) : z 1— )■ [|\E'(2))], 



which is no longer injective in the case where \l/ satisfies Eq. (35). 



The puUback gz of the induced Fubini-Study metric g^^lz)) ^'^ TJJ^ = is given by 



g^-.C^xC""^ C: 
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Correspondingly, the entries gij are given by 

and originate from a Kahler potential 

= log(iV(2,2)) =log((vl/(2)|vI/(2))) (38) 

In the first case, where Ai contains at most a single representative on every ray of vectors 
in H, is still a positive definite matrix and can readily be inverted. In the second case, 
where Ai contains parts of rays of vectors, the pullback metric is degenerate and no longer 
constitutes a proper Riemannian metric, due to the non-injectivity of Hence, there is no 
unique way to define an inverse metric. A more formal treatment in terms of fiber bundles 
and bundle connections is given in the next section, where even the map \I' itself is non- 



injective. For now, we continue in a more intuitive way. Given the validity of Eq. (35), 
there must exist some v{z) e T^U+ = C" such that \^{v{z);z)) = v'{z) |5i^(z)) = |^(2)). 
For the particular subcase where |\l'(Az)) = /(A) |\I'(z)), we obtain v{z) = z//'(l) by 
differentiating this relation with respect to A at A = 1. It can easily be checked that 
gij{z, z)v^ (z) = 0. Hence, we can define an equivalence relation between tangent vectors 
w G TJJ^ = C™" as Wi ~ W2 if Wi — W2 = av{z) for some a G C. The tangent space 
Ti\^(z))]-M. is isomorphic to C"/ ~ and we need to impose a condition in order to associate 
a unique vector w G C'" to tangent vectors in T[|^(2))]7W. Unlike in the total Hilbert space, 
working with the orthogonal complement of v{z) would not be a natural choice, as there 
is no intrinsic notion of orthogonality and this choice depends on the parameterization of 
the manifold. Instead, the transition from affine Hilbert space to projective Hilbert space 
implies that the natural condition to impose on tangent vectors w is that 

{^{z)\(!>{w; z)) = {^{z)\di^{z)) w' = 0. (39) 

We can then define a pseudo-inverse of the pullback metric with entries g^^{z, z) that satisfy 

9'[z,z)gjk{z,z) - di^-v [z)^^^^^^^^^^^^. (40) 

The right-hand side acts as a projector (not an orthogonal one) that transforms any vector 



w into an equivalent one that satisfies the condition in Eq. (39). Put differently, the pullback 



metric acts as a proper inner product in the subspace of C™ that satisfies Eq. (39). 
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We carefully proceed by introducing a Levi-Civita connection and a Riemann curvature 
tensor using the puUback metric and its pseudo-inverse rather than a proper metric and its 
inverse. We check the consistency of this approach at the end of this subsection. For the 
non-zero entries of the connection F, we obtain 



f = t-'dCgm, , f^' = r%km, (41) 



with 



(-'igmj 



2 



(^'1^') (^1^)^ (^1^) 

v2 +^ /,T,I.T,\3 



(42) 



As before, we have omitted the arguments z and z for the sake of brevity. To compute the 
Riemann curvature tensor, we need an expression for dfng^\ which can be obtained from 



applying dfn to Eq. (40) and multiplying with resulting in 
_ - / - 0-\E'l\I^^ A _ - / - 



the unique solution to which is given by 

dmf = -f(d^~9jk)f - v'sL. (43) 

Here we used that 

g,jV^ = and = 0, 



which are the conditions that led to the precise form of the right hand side of Eq. (40). 
Differentiating these identities further leads to 

{digmj)v^ = -gmjdiV^ and {digmj)v'^ = 0, 

since v depends on z holomorphically. With these identities at hand, we can show that the 
covariant derivative Vj annihilates the metric 

Vig-jk = dig-jk - Tik g-ji = 0- (44) 

Hence, the defining relation of the Levi-Civita connection is still preserved, even though we 
have been using a pseudo-inverse of a degenerate puUback metric. In addition, the identities 
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above are required to prove that the entries of the Riemann curvature tensor R are still 
given by 

hki = -a-iJAr = dAkk - {M^) {d,~9^k) (45) 



(46) 



with 

^ (dj^m (dj^m (^l^fc^) 

Note that for any tensor T, the contraction of a covariant index i with f * or of any con- 
travariant index j with should be zero, if we want to be able to consistently lower 

and raise indices with the metric and its pseudo- inverse. This can explicitly be checked for 
the Riemann curvature tensor. However, from the identities above we obtain 

= -~g''^~g^,{d,v^) = -d,v' + v'^^^^{d,v^) + (47) 

which is compatible with the Levi-Civita connection not being a proper tensor. 



III. GEOMETRY OF GENERIC MATRIX PRODUCT STATES 

In this section we study the geometry of generic matrix product states (MPS) for finite 
one-dimensional lattices, which were identifiecP^'^ as the variational states implicitly created 
by White's density-matrix renormalization groupP^'^. Subsection III A first summarizes 
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the definition and key properties of the variational set. Secondly, in Subsection IIIB 



we 



discuss the properties of the representation \& itself, as studied in great detail in Ref. HH 
We identify matrix product states as having the structure of a principal fiber bundle and 
introduce the necessary concepts and definitions. In particular, we identify the parameter 
space as the total space or bundle space and the manifold A^mps C H as the base space. 



Subsection |III C| introduces the tangent space of these manifolds and discusses the relation 
between the tangent bundle of the parameter space and the tangent bundle TA^mps- In 
order to associate a unique parameterization to each tangent vector of the physical space. 



we need to introduce what is called a bundle connection. In Subsection III D[ we repeat the 
whole construction for the manifold A^mps C P(EI). Finally, in Subsection 



HIE 



we define 



the puUback metric and introduce an efficient parameterization for tangent vectors such that 
the metric becomes the identity. 



A. Definition and properties 

Consider a one- dimensional lattice £ with |£| = sites labeled by the integer n G £ = 
{!,..., A^}. Every site n contains a g„- dimensional quantum variable, so that the local 
Hilbert space ]HI„ = is spanned by a basis {|s„) | s„ = 1, . . . ,gn}- The total Hilbert 
space is given by EI^ = (S)^=i and is spanned by the product basis 

\{Sn]) = \S1S2 ...Sn) = ® \S2)2 ® " " " » I^At)^ . (48) 

The dimension of is thus given by dimEI^ = n^=i and the specification of an arbitrary 
state 1^) G Mc requires a value for each of the coefficients Csj,s2,...,sjv corresponding to the 
element |siS2 ■ ■ ■ sn) of the basis. 

In a MPS, the coefficients Cs-^,s2,...,sm with respect to the chosen basis |siS2...SAr) are 
obtained as a product of matrices, hence the name. The variational parameters correspond 
to a set of g„ complex Dn^i x Dn matrices A'^^n) {s = for every n E C = 

{!,... , A^}, where Dq = Dj^. The objects A{n) can also be interpreted as rank 3 tensors 
with entries where there is one physical index s„ = 1, . . . , and two virtual indices 

a = 1, . . . , Dn-i and /3 = 1, . . . , -D„. The integers Dn are called the bond dimension or 
virtual dimension of the MPS. For a given lattice C with local Hilbert spaces M.n and fixed 
bond dimensions {Dn}n=i,...,N, we can thus define the MPS parameter space Amps as the 
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complex Euclidean space 

N 

Amps = 0C^"-' (49) 

n=l 

with 

N 

dim Amps = (50) 

n=l 

We can now define the MPS variational class. 

Definition 7 (Matrix product state). An MPS is defined as the holomorphic map 

Amps ^►H^: (51) 

where we misuse the functional notation [A] for the dependence on a discrete set of objects 
A = {A{1),A{2), . . .,A{N)} = {A{n)}n=i,...,N, and is given by 

91 9jv 

= E • • • E [^"(1) • • • A^HN)] \s,s, ...s^). (52) 

Sl = l sjv = l 

Despite the slightly confusing terminology, we refer both to the set of tensors A e Amps and 
to the corresponding physical state |^[^]) £ as a MPS. 

Note that it is always useless to choose Dn > gn-^n-i or Dn-i > qnDn- For example, if 
Dn > Dn-iqn then define the {Dn-iqn x Dn)-iiiatrix ^4(0,5)^^(71) from reordering and grouping 
the indices of the tensor A{n). The rank of the matrix A(^as),p{'n) is limited by Dn-iQn, and 
there exists a Dn-iq-n x Dn-iQu matrix B(^as),'y{n) and Dn-iqn x -D„ matrix Q^^i3 such that 
A(Qs)^^(n) = '^yZi^'^" B{as),'yQ'y.8- Without loss of accuracy, wc can redefine A*(n) B^, 
A'^{n + 1) QA^{n + l) and Dn ^ D^-iqu- A similar proof holds for the case D^-i > qnDn- 

We can now define a variational set 

VMPS = {|*[^])|VAe Amps}. (53) 

The notation Vmps will not be cluttered with explicit notation of the lattice £, or the local 
Hilbert dimensions {f/„}. The bond dimensions {Dn}n=i,...,N can be indicated explicitly as 
Vmps{d„} when confusion between different choices of {Dn}n=i,...,N is possible. The vari- 
ational set Vmps contains contains rays of states, since it corresponds to the case where 
mXA]) = /(A) mA]) for all A e C, with /(A) = A^. The set Vmps{d„} is definitely 
not a vector space, since for two states l^^fAi]) , |^[A2]) G Vmps{£i„}, the MPS represen- 
tation of |^[^i]) + I ^[^2]) requires in the most general case a set of bond dimensions 
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{D'^ = 2Dn}n=i,...,N- Put differently, in the most general case we obtain |\Ef[y4i]) + |\E'[y42]) = 
G Vmps{d;}, where {A'y{n) is constructed as {A'y{n) = Al{n) © Vs = 

1, . . . , g„, Vn = 1, . . . , A^. Unlike in the previous section, the map is not injective and 
we need a more detailed study to investigate whether Vmps can be given the structure of a 
complex manifold, which is the subject of the next subsection. 

If a different set of bond dimensions {-D^}n=i,...,Ar satisfies D'^ < Dn, = 1,...,N, 
then Vmps{d;j C. Vmps{d„}- A MPS |\E''[y4']) G Vmps{d;} can be identified with a state 
|^'[^]) e Vmps{a.} by setting, Vn = 1, . . . , iV, Vs = 1, . . . , Al^{n) = (A')^,^(n) for 
a = 1, . . . , D'^_i and (3 = 1, . . . , D'^, and v4^^^(n) = for all other combinations of a and 
f3. It will be shown throughout the remainder of this section that the subsets Vups{d'„} of 
Vmps{d„} correspond to the singular regions where e.g. the pullback metric g becomes (more 



strongly) degenerate, which is made more precise in Subsection HIE In order to define a 
variational manifold, these singular regions have to be removed by restricting to an open 
subset ^MPS C Amps- The corresponding image under the map \I' defines a set A^mps 
that can be given the structure of a complex manifold, which is the main result of the next 
subsection. 

Before getting there, we first have to define some additional quantities, which natu- 
rally occur when evaluating expectation values of physical operators operators with respect 
to a MPS |\E'[yl]). Physical operators correspond to elements of the set L(]Hl£) of linear 
endomorphisms of H^. To the virtual bond dimensions of the MPS [^'[A]), we can 
associate ancillas or virtual systems whose pure states live in C"^". The expectation value 
(\I'[y4]|0| |^[v4)) involves both the MPS and its dual, which depends on the complex conju- 



gate variable A = {A{n) = A{n)}n=i,...,N and involves a set of dual ancillas. Any physical 
operator in L(El£) can be expressed as a linear combination of elementary product operators 
given by 

N 

= (g)0„, (54) 

n=l 

with On a local operator acting non-trivially only on EI„. For such product operators, we 
now introduce the concept of a superoperator. 



Definition 8 (Superoperator). Let be a MPS with virtual bond dimensions 



■.1,...,N 



and let the physical operator O be a product operator as defined in Eq. (54). For every 



local operator On acting non-trivially on site n alone, we define a superoperator Eo(n) as a 
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linear homomorphism from the tensor product ancilla space C^" ® C^" to C^""^ (8) C^"-^, 
according to the definition 

Qn 

Eo„(n) ^ Yl {s\On\s')A'^'in)^AHnj. (55) 

s,s'=l 

Each superoperator Eo„(n) can thus be represented as a matrix of size -D^_i x D"^. 

Using this definition and the property tr(A) tr(i?) = tr(A ® 5) = tr(S ® A), we now 



obtain for the expectation value |0|^[A]) of the product operator O [see Eq. (54) 



mA]\dmA]) = tr [Eo,(l)Eo,(2) ■ ■ ■ Eo,(iV)] . (56) 

For the evaluation of the expectation value, the different superoperators associated to the 
subsequent sites have to be multiplied. Starting at the site n corresponding to the smallest 



bond dimension D^i^ = min{D„}, Eq. (56) can be evaluated with a total computational 
cost that scales as O^D'^^^D^^^) by exploiting the tensor product structure of Eo(7^), where 
Anax = max{D„}. For a lattice with open boundary conditions, we have -Dmin = Dq = Djy = 
1 and the total computational cost for evaluating expectation values scales as 0{D'^^^). For 
a translation invariant state on a lattice with periodic boundary conditions, we expect 
-Dmin = -Dmax = -Dn = D, and wc obtain a more unfavorable scaling 0{D^). 

To every superoperator Eo(n) we can associate a map S,q^: L(C^") — t- L(C'^""^) from 
virtual operators x acting on the ancilla space C^" to virtual operators 8,q\x) acting on 
the previous ancilla space C^""^ via the prescription 

Qn 

E^o^ : L(C^") ^ L(C^"-i) : x ^ S,'o\x) = J] {s\d\s') A'' {n)xA'{ny . (57) 



s,s'=l 



Analogously, a second map £q ■* is defined as 



o 

qn 



£[,"^ : L(C^"-i) ^ L(C^") : x ^ E.^o\^) = ^^l^'^') ^'inYxA'' (n). (58) 

s,s'=l 

Via the Choi-Jamiolkowski isomorphisrcP^^^'^, virtual operators x in L(C'^") can be as- 
sociated to vectors \x) in the ancilla product space C^" ® C-^", for which we introduce a 
braket-style notation with round brackets. The relation between the maps £o, £o and the 
superoperator Eq is given by Eo(n)|x) = \8.q\x)) and {y\Ejo{n) = (£q^(?/)|. Note that 
these maps only require multiplication of matrices in the original ancilla space, and can 
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thus be implemented as operations with computational complexity 0{D^). A particular role 
is played by the map S^"-* = which is completely positive and for which the matrices 
A^{n) are the Kraus operators.-^ This map appears at every site n where O acts trivially 
{i.e. On = !)• Its importance follows from the observation that many relevant operators 
only act non-trivally on a few sites {e.g. local order parameters, correlation functions, . . . ). 
The corresponding superoperator Ej{n) = Ei(?2) is reminiscent of the concept of transfer 
operators in statistical mechanics and is henceforth referred to as such. For the remainder 
of this paper, we define a generalized superoperator 

4 ^ ® 5^, (59) 

s=l 

so that E(n) = F^f^y 

For a lattice with open boundary conditions, the expectation value of product operators 
O can be computed with computational complexity 0{D^). Most interesting operators {e.g. 
local operators, short-range interaction terms in the Hamiltonian, correlation functions) can 
be written as a small sum of such product operators, so that the computation of their ex- 
pectation values inherit this very favorable computational complexity. Since most operators 
are trivial {On = 1) on the majority of sites, we define the sets of virtual density matrices 
/ = {l{n)}n=o,...,N and r = {r{n)}n=o,...,N for the auxiliary system via the recursive definitions 
(Vn=l,...,iV) 

l{0) = 1, l{n) = {l{n - 1)) ; (60a) 
r{N) = l, r(n- 1) = £(")(r(n)); (60b) 

all of which can be computed with computational complexity 0{D^). The expectation value 
of a strictly local operator is then given by (\E'[A] |On|^[yl]) = {l{n — l)\E,o„{n)\r{n)) and 
the normalization of the state is given by (\E'[y4] |\E'[74]) = 1{N) = r(0) = tr[/(r;,)r(r;,)] = 
{l{n)\r{n)), Vn = 0,...,A^. The matrices l{n) and r{n) are Hermitian and positive semi- 
definite. Further conditions on l{n) or r{n) can be imposed by exploiting the freedom in 
the MPS representation, as discussed in the next subsection. We henceforth restrict to the 
case of MPS with open boundary conditions. The case of translation-invariant MPS with 
periodic boundary conditions will be discussed in the next section. 
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B. The principal fiber bundle of matrix product states in affine Hilbert space 



We now study the properties of the MPS representation [^['[A)]) in Eq. (52 ) and investigate 
the structure that can be given to the map \I/ : Amps ^c- The redundancy in the represen- 
tation of physical states |\I/[v4]) by a set of matrices or tensors A = {A(^)}n=i,...,Ar £ Amps, 
i.e. the non-injectivity of the map has been studied in great detail in Ref. HT]and is here 
reviewed, since this is essential for the remainder of the paper. 

We start by introducing a group Gmps of local gauge transformations that leave the 
physical state 1^1' [A]) encoded by the set of tensors A invariant. 

Definition 9 (Gauge group of MPS). The group Gmps of local gauge transformations is 
defined as the direct product 

N 

Gmps = J] ^"-Pn; C) = Gl{D,X) x GL(D2, C) x ■ ■ ■ x GL(D„, C). (61) 

n=l 

Note that Gmps is a complex Lie group, according to Lemma |3} with complex dimension 
given by 

N 

dimGMPs = $^/^'. (62) 

n=l 

In addition, we need to specify a group action P : Amps x Gmps Amps to give meaning 
to the invariance of MPS under the action of the gauge group. Following the standard 
convention in the fiber bundle literature, we choose to work with a right action. 

Lemma 4 (Group action). The map 

r : Amps x Gmps ~^ Amps '■ 

{A,G) = ({A(n)}„=i,...,;v,{G(n)}„=i,...,^) ^ T[A,G] = ^[^1 = {A^''\n)}n=i,...,N (63) 

where A^'^^{n) is defined as 

Vs = l,...,g„: A^^^'{n) =G{n-l)-^A'{n)G{n) (64) 

with G{0) = G{N), is a right group action of Gmps on Amps- In addition, the map P is 
holomorphic. 

Proof. The following two properties are trivially fulfilled: 
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• Identity: The identity element Igmps ~ {lz)„}n=i,...,Ar with Id the unit matrix of size 
D X D, acts as T[A, Igmps] ~ ^ ^'^^ ^ ^ -^mps 

• Associativity: r[r[74, Gi], G2] = T{A, G1G2) for any A G Amps and any Gi, G2 G Gmps, 
where G1G2 = {Gi{n)G2{n)}n=i,...,N is the standard group product in the product 
group Gmps- 

We can thus conclude that F is a right group action. 

In addition, it is easy to prove from the definition that the map F from the complex 
manifold Amps x Gmps (see Lemma [2]) to the complex manifold Amps is holomorphic. For any 
G G Gmps; we can define an open neighborhood containing G in which we can use the matrix 
representation of the matrices G{n) in C^"^'^" as coordinates. Since the matrix entries of 
G^^{n) depend on these coordinates holomorphically according to the definition of a complex 
Lie group, and Amps is endowed with the standard Euclidean coordinates, it is clear that F 
is a holomorphic map. In particular, for any G G Gmps, the map Amps ~^ Amps- 
is biholomorphic. □ 

Corollary 5 (Gauge invariance of MPS). 

VG G Gmps, VA e Amps : l^i^t^l]) = . 

Put differently, the parameter space Amps is intersected by gauge orbits corresponding to 
the action of Gmps, where all points on a gauge orbit correspond to equivalent representations 
for the same physical state |\1'[A]) G EI^. 

The previous results were valid for any MPS with open or periodic boundary conditions. 
We now restrict to the case of open boundary conditions, and define a subset ^mps of Amps- 

Definition 10 (Full-rank MPS). Consider a class of MPS with open boundary conditions 
{Dq = = 1)- The subset ^mps of full-rank MPS with open boundary conditions is 
defined as 

^MPS = {Ae AmpsIV^ = 0, . . . , : l{n) > and r(n) > 0} , (65) 
where the virtual density matrices of a MPS with open boundary conditions were defined 



in Eq. (60). Hence, all virtual density matrices should be strictly positive definite, i.e. they 
should have full rank on top of being positive semi-definite. If we defineD„_ig„ x Dn matrices 
V(as);^(n) = yl^_^(n), the positive definiteness of the left density matrices l{n) requires that 
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all matrices V{n) have maximal rank, namely rank(l^(n)) = D„. Similarly, the -D„_i x 
matrices Wa-(si3){n) = v4*^^(n) should have maximal rank -D„_i if the positive definiteness 
of the right density matrices r{n) is given. 

Lemma 6. The subset ^mps of full-rank MPS is a complex manifold with dim^MPS = 
dim Amps- 

Proof. The density matrices l{n) and r{n) depend on the tensors A = {A{m)}m=i,...,N con- 
tinuously. The linear independence of the columns and rows of l{n) and r{n) will not be 
affected by sufficiently small perturbation^^'^ll^ sq that there must exist an open neighbor- 
hood around every A G ^mps where all virtual density matrices remain positive definite. 
Hence, v4mps is an open subset of the complex Euclidean space Amps and Lemma [T] can be 
applied. □ 

Under the group action A ^ A^'^\ we obtain the following transformation behavior for 
the left and right density matrices 

l{n) <- f^\n) = \G{0)\-^G{n)U{n)G{n), (66a) 
r{n) i- r^^\n) = \G{N)\^G{n)-^r{n){G{n)-y . (66b) 

and it is clear that the group action preserves the decomposition of Amps into ^mps and 
its complement. We now study the restriction of the group action to ^mps? which we still 
denote using F. The defining conditions of ^mps are required to prove additional properties 
of the group action and to gain better insight into the structure of the gauge orbits. 

Lemma 7. For any A G ^mps; ihe stabilizer subgroup G'^^ C Gmps of transformations G 
that leave A invariant (i.e. T[A,G] = A) is given by = {cIgmps = {ctn„}n=i,...,N\c G 
Co} = GL(1,C), with Co the set of all non-zero complex numbers. 

Proof. A necessary condition for A^^^ = A is that, for any n = 1, . . . , N 

In 

J2A'in)n{n - 1) {A^^^y (n) = l{n). 

s=l 

Since G(0) = G{N) G GL(1,C), we have G(0) = G{N) = c E Cq. Applying the condition 
above for n = 1 results in 

f^A^iym (A[^])^(i) = -/(i)G(i) = /(i). 

27 



Geometry of Matrix Product States 



Since, for a full-rank MPS A G ^mps, all /(n) are positive definite and hence invertible, the 
equation above can be used to solve for G{1) by left multiplication with resulting in 

G{1) = cId-^. Continuing along these lines, we obtain G{n) = cId^, for all n = 1, . . . , A^. 
It can indeed be checked that this particular choice G = cIgmps — {clD„}n=i,...,Af results in 
T{A,G) = A. Hence, we obtain Gl^l = {ct\c e Co} = GL(1,C). □ 

Definition 11 (Structure group of matrix product states). The structure group Smps 
of MPS is defined as Gmps/GL(1, C). Since Gmps is a direct product group containing 
GL(DAr,C) with Dn = 1, we obtain 

7V-1 

Smps = Gmps/GL(1, C)=\[ GL(D„, C). (67) 

n=l 

The use of the name 'structure group' will become obvious further down. Smps is also 
a complex Lie group with dim Smps = dim Gmps — 1- The group action P of Gmps also 
defines a group action for Smps by setting G{Q) = G{N) = 1. Obviously, this group action 
is also holomorphic. We use the same symbol P as the difference is clear from specifying the 
domain. 

Corollary 8. The group action P : ^mps x Smps — ^ -^mps is free, i.e. the stabilizer 
subgroup S"^ of any A G ^mps is given by the trivial group {IsmpsI containing only the 
identity Is^pg = {lD„}n.=i,...,7v-i- 

It can also be checked that elements G = cIgmps leave any A G Amps invariant. Hence, 
this normal subgroup also corresponds to the kernel of the group action. For elements in 
the complement of ^mps? the stabilizer subgroup will typically be larger so that even the 
action of the structure group Smps on the whole space Amps is not free. This illustrates 
the importance of restricting to the subset ^mps of full-rank MPS. Note, however, that the 
proof above only requires that all left virtual density matrices / = {/(^)}n=o,...,Af are positive 
definite. A similar proof can be constructed by only using that all right virtual density 
matrices are positive definite. The simultaneous positive definiteness of both sets of density 
matrices, as imposed in the definition of ^mps; is used below. 

Finally, we also need to show that the group action P : ^mps x Smps — ^ -^mps is proper. 
A group action is proper if the map ^mps x Smps — ^ ^mps x ^mps ■ (A, G) ^ {A, A^^^ = 
T[A,G]) is proper, i.e. if the preimage of compact subset of ^mps x ^mps corresponds to 
compact subsets ^mps x Smps- We cite the following theorem without prooP^ 
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Theorem 9. A group action T : M. x G ^ M. of a real Lie group G on a complex manifold 
M. is proper if G is a closed subgroup of K\xt{A4.), the group of holomorphic automorphisms 
on JH, and preserves a continuous distance on M.. 

A few remarks are in order. Any complex Lie group is also a real Lie group. Since our 
group action F is a holomorphic map from the complex manifold ^mps x Smps to the complex 
manifold ^mps, we have that in particular the map rt"^' : ^mps -Amps is a holomorphic 
automorphism for any G G Smps- Hence, in order to be able to apply Theorem [9} we only 
need a distance function on ^mps- We therefore define 

„1 TV 

Dmps[^,^] = min / Y,{l{n - l-t)\m^^^^\r{n-t))dt (68) 

^0 n=l 

for any piecewise smooth path A : [0,1] — ?■ ^mps '■ t ^ A(t) with A{0) = Aq and A{1) = 
Ai, and with l{n;t) and r{n;t) the density matrices defined by A{t). The integrandum 



is inspired by, but not equivalent to, the puUback metric obtained in Subsection |IIIE 
Whereas the puUback metric would result in a zero distance between different points Aq 
and Ai which are gauge equivalent {i.e. Ai = T[Aq,G] for some G), the integrandum used 
above is strictly positive for A(t) G ^mps and any two distinct points Aq ^ A^ result in 
-Dmps[^0) ^i]) > 0. Note that the positiveness of the distance depends on both sets of density 
matrices {\}{p)^n=Q,...,N and {r(n)}„=o,...,Af) having full rank. In addition, by substituting 
A{t) ^ A[^l(t), l[n) ^ /[^l(n) = G[n)n[n)G[n) and r[^l(n) G(n)-V(n)(G(n)t)-i, we 
obtain Dmps[^05^i] = -Dmps[^o^^, ^P'] ^^r any G G Smps, so that the distance function D 
is invariant under the action of Smps- We can thus conclude: 

Corollary 10. The group action V : ^mps x Smps ~^ -^mps proper. 

We can now use one of the basic theorems from the fiber bundle literatur d^^ * ^^ *: 

Theorem 11 (Quotient manifold theorem). If A is a smooth manifold, S a Lie group and 
T: A X S A a smooth, free and proper group action then 

• The orbit space A/S is a smooth manifold with dim^/S = dim^ — dimS. 

• The natural projection tc: A ^ A/S is a smooth submersion 
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Correspondingly, n: A ^ A/S is a principal fiber bundle with total space A, base space 
A/S and structure group S. Since the complex manifold v4mps is in the first place a smooth 
manifold, and the holomorphic group action F is a smooth map, they can be used to conclude 
that the MPS orbit space ^mps/Smps is a smooth manifold. 

In addition, for complex manifolds and a complex Lie group, we also state the following 
theoremP^: 

Theorem 12. LetT: AxS A be a holomorphic, free and proper group action of a complex 
Lie group S to a complex manifold A. Then the orbit space A/S is a complex manifold and 
the quotient map n: A^ A/S is holomorphic. 

In addition, the natural projection map or quotient map n: A A/S has a universal 
property: 

Lemma 13. Any holomorphic map A ^ Ai that is invariant under the action of S 
factorizes as = ip o it , where ip is a holomorphic map from the orbit space A/S to M.. 



According to Theorem 12, the MPS orbit space ^mps/Smps is a complex manifold. Since 



the MPS representation ^! : ^mps is invariant under the group action. Lemma [13 

dictates that it has a natural restriction ip : ^mps/Smps ^c, which is also holomorphic. 
By the transition from Amps to the subset of full-rank ^mps? this restricted map is made 
injective, as we now show in what is considered the main result of this subsection: 

Theorem 14. The variational class of MPS \1' : ^mps ^ -^mps is a principal fiber bundle 
with structure group Smps; base manifold A^mps; total manifold ^mps o.iT'd bundle projection 
\E'. The variational manifold A^mps is a complex manifold that is biholomorphic to the orbit 
space ^mps/Smps <ind thus has dimension 

dim MPS = dim^MPS - dimSMPs = dim Amps - dimGMPs + 1- (69) 

Proof. Since A^mps is defined as the image of ip- -^mps/Smps or, equivalently, the 

image of ^: ^mps ~^ and we already know that ip is holomorphic, it suffices to show 
that ip: w4mps/Smps is injective. Put differently, we need to show that the preimage 

of any point for the map \1': ^mps — > corresponds precisely to the gauge orbit 

{A'*^], G E Smps}) which is also known as the fiber corresponding to the base point |\E'[y4]). 
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FIG. 1. Illustration of the principal fiber bundle interpretation of the MPS prescription. The closed 
lines in parameter space Amps correspond to gauge orbits that are mapped to identical physical 
states in Hilbert space H. The dot in the middle corresponds to a MPS that does not have full 
rank. The gauge orbit looks fundamentally different and this point has to be excluded from the 
set ^MPS in order to define a principal fiber bundle. 

A recipe for finding the MPS representation of any state in the Hilbert space M.c of 
a one-dimensional lattice with open boundary conditions is given in Ref. [571, It is based on 
a series of Schmidt decompositions (singular value decompositions) of the coefficient matrix 
C(si,...,s„),{sn+i,---,SN) corresponding to bipartite cuts between any two sites n and n + 1. For a 
state |\E'(A)) with A G Amps, the Schmidt rank (number of nonzero singular values) corre- 
sponding to a cut between sites n and n + 1 is at most D„ and the corresponding Schmidt 
coefficients (singular values) are given by the eigenvalues of >yi{ny/'^r{n)l{ny/'^ or, equiv- 
alently, the eigenvalues ^yr{ny/'^l{n)r{ny/'^. By restricting to A G ^mps, all matrices l{n) 
and r{n) are strictly positive definite. Correspondingly, all Schmidt coefficients are non- 
zero and the Schmidt rank corresponding to the cut between sites n and n + 1 is precisely 
Dn- Under these conditions, the Schmidt decomposition becomes unique, up to permuta- 
tions and degeneracies in the Schmidt coefficients. This freedom corresponds precisely to 
transformations G G Smps- This construction can also be found in Ref. HU □ 

A visualization of the interpretation of MPS as a principal fiber bundle is presented 
in FIG. [l] For a normalized state (\E'[yl]|^[yl]) = 1, the square of the Schmidt coefficients 
sums to one, since (\E'[A] |\E'[y4]) = tT[l{n)r{n)]. The entanglement spectrum is then defined 
as spectrum of normalized squared Schmidt coefficients, or the negative logarithm thereof, 
depending on the convention. 
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One can now try to associate a unique A G ^mps to every G A^mps, or equiv- 

alently, to every point in ^mps/Smps- This corresponds to constructing a bundle section 
ip: A^MPS — ^ -^MPS) ^-C- a right inverse of oip = Id-Mups- While there is no easy way to 
explicitly specify a cross section, it is possible to try to characterize the points A G f{M.MPs) 
by specifying a number of conditions that they should satisfy. Physically, these are called 
gauge fixing conditions and a MPS A fulfilling these conditions is said to be in a canonical 
form. Any MPS A' can be brought into a canonical form A = T{A', G) by acting with a 
transformation G G Smps- In Ref- SH a right-canonical form was constructed in two steps 
as: 

• Firstly, the right orthonormalization condition is imposed (for all n > 1) 

^ A^(n)A^(n)t = e(")(l^J = lz,„_, (70) 

s=l 

so that r{n) = l^i^ and the gauge freedom is reduced from G{n) G GL(?2;C) to 
G{n) G U(n) (Vn = l,...,Ar- 1); 

• Secondly, the left density matrices l{n) are diagonalized using the remaining uni- 
tary gauge freedom. Clearly, /(n)/ tr[/(?T,)] contains the entanglement spectrum cor- 
responding to a bipartite cut between site n — 1 and site n. In addition, we obtain 
tr[/(ra)] = r(0) = for any n = 1, . . . , A^. 

Alternatively, a left-canonical form can be defined. We refer to Perez-Garcia et al^, 
SchoUwock'^ for an efficient algorithm to obtain the canonical form starting from an ar- 
bitrary MPS. Strictly speaking, these gauge-fixing conditions do not identify a unique point 
within the gauge orbit even when the entanglement spectrum is non-degenerate, since there 
is still a freedom of choice in the phase of the eigenvectors that are used to diagonalize l{n), 
for every n = l,...,A^ — 1. This residual gauge freedom corresponds to 

N-l 

U(l) X U(l) X ■■■ X U(l)^ . 

n=l „ i- 

Dn times 

Finally, we elaborate on the difference between the set of full-rank MPS and the set of 
injective MPS as defined in Perez-Garcia et al.^. For the set of full-rank MPS, the restricted 
map ip '■ -^mps/Smps A^mps becomes injective. Given the physical state I^E'fA]) in any 
way, we can determine from it the unique fiber {A^'^\G G Smps} corresponding to this 
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state. The set of injective MPS are smaller, as it corresponds to those states such that the 
unique fiber {A^'^\G G Smps} can be determined from local information about only. 
More precisely, the fiber {A^^^G E Smps} — and thus also the state |^E'[^]) — is completely 
determined by the set of all local density matrices of i subsequent sites, where i is called the 
injectivity length. These states can then be obtained as unique ground states of local parent 
Hamiltonians, which is not necessarily the case for all full-rank MPS. In the next section on 
uniform MPS, we restrict to the smaller set of injective MPS, as they are the only ones that 
have a unambiguous thermodynamic limit. 



C. Tangent bundles and the principal connection 

Using the pushforward d\E' of the bundle projection \E', we can define a bundle map 
d\E': TA^pg — 7- TA^jJjpg between the holomorphic tangent bundle of ^mps and the holo- 
morphic tangent bundle of A^mps- At any point A in ^mps, we have ^a^mps ~ -^mps by 
virtue of Lemma [l] In addition, the holomorphic tangent space T^i^j^j) A^jJ^pg C is bi- 



holomorphic to a subspace of H^, as denoted in Subsection II B It was illustrated in Ref. 
and Il3] that this subspace defines a useful variational class to study the excited states of a 
Hamiltonian for which |^E'[v4]) is a good ground state approximation. 

As in the previous section, we define a map |$) : TA^^p^ — ?■ Mc : A) \^[B; A]) with 

n=l i=l 

N / qi q„ QN \ V / 

n=l \si=l Sn = l sjv = l 

where z is a collective index i = {a, s, /3) that combines the physical index s and the matrix 
indices a and /3. A general tangent vector |$[-B; A]) is thus built from N MPS, where one of 
the tensors A{n) is replaced by B{n). For the sake of brevity, we also introduce the notation 
^*[A]>-Mmps — '^MPS ^^"^ define the linear homomorphism d'^ a — "^"'"^^ as 

$[^1: T^^+PS = Amps ^ T^J^s: B ^ |<I>[^1[S]) = MB; A]) . (72) 

Often, we omit the explicit notation of the base point A in the notation of the tangent space 
Tmps and its vectors if this is clear from the context. 
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Since for any G e Smps, the map Tt^l : Amps ^ Amps: A h> T^^^A) = T{A,G) = A^^^ 
describes a biholomorphism, we can define the pushforward biholomorphism of the tangent 
bundle to itself 

drt^l : TAmps ^ TAmps : {A, B) ^ (A^^], ^l^l) (73) 
where the group action on the tangent vectors B is given by 



s[-i = drf^(5) = $:5^(H^A[-i 



B^''\n) = Y,B 



dAHm) 



(74) 



dAHra] 

m=l ^ 



which results in 

(51^1)' (n) = G{n - iy'B%n)G{n). (75) 

We have thus defined a group action on the complex tangent bundle T^d^jpg, which is also 
a complex manifold in its own. 

Definition 12 (Group action on tangent bundle). Given the group action F : ^mps^Smps 
^MPs: iA,G) r[A, G] = A^'^\ a group action on the tangent bundle TA^po, can be 
defined, which is denoted as dF and given by the prescription 

dr: T^+pg X Smps ^ TAt^p^: iiA,B),G) ^ dT^^\A;B] = (A^^^B^'^^). (76) 

It can be proven that the group action dF of the complex Lie group Smps on the complex 
manifold TA^p^ is also free, proper and holomorphic, and allows one to define a principal 
fiber bundle TA^p^ — t- (T^j[jpg)/SMPS) where (T^jJjpg)/SMPs can also be given the structure 
of a complex manifold. In addition, it can easily be checked that the map d\E' is invariant 
under the action of Smps- Indeed, explicit insertion in the definition shows At"^']) = 



for any G G Smps- According to Lemma 13, the map d\E' thus has a natural 
restriction to a map (T^p[^pg)/SMPs — ^ ^-^mps' which is typically also denoted using the 
same symbol d\E'. 

Note, however, that (T^j|^pg)/SMPs is not equal to T(^mps/Smps)^ and that the re- 
striction of d\I' is not the same as dip. This can easily be seen by counting dimensions. 
Whereas dim(T^jJ;jpg)/SMPs = 2dim^MPS — dimSMPs, we have dimT(^MPs/SMPs)'^ = 
2(dim^MPS ~ dim Smps)- One particular consequence is that, while dip would be injective, 
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the restriction d\l/ : (T^j|^pg)/SMPs — ^ ^-^mps Indeed, after the multiphcative gauge 

freedom of Smps is ehminated by e.g. fixing a particular A G ^mps? the hnear homomor- 
phism $[^1 has a non-trivial kernel N'^^ C Amps that contains vectors Yln=i ^ 



dA^(n) 

that are tangent to the fibers of the bundle \E': ^mps A^mps- The tangent vectors in 
the null space C Amps were called zero modes in Ref. EHl In the fiber bundle litera- 
ture, Nl^l C Amps is called the vertical subspace of T4^mps' '^^^ define a vertical 
subbundle Ver TA^p^ with base manifold ^mps and the fiber at base point A given by 
Nt^l = Ver TaAI^ps. Naturally, we obtain \^^^^B + B']) = for any B' e Nt^l In 
order to associate a unique parameterization B to every tangent vector of Tj^pg, we need 
to introduce an Ehresmann connection, for which there are a number of equivalent defini- 
tions. The Ehresmann connection defines at each point A G ^mps a horizontal subspace 
Bl^l 4 Hor TaA^ps such that 

TaA^ps = Amps = Ver TaA^ps © Hor TaA^p^ = N^^^ ®M^^\ (77) 

Every tangent vector G Tmps then has a unique representation B G M^^\ which is 

called the horizontal lift of l^f-B]). The Ehresmann connection can also be introduced as 
a one-form u that takes value in the vertical subspace and acts like a projection on it, i.e. 
ua is a map from T^^mps - ^mps to Nt^l such that ua[B] = B for any B G N^^l The 
horizontal subspace is then defined as 

bI^I = ker UA = {B e AupsWa[B] = 0} . (78) 

Since the fiber bundle \E': ^mps ~^ -^mps is a principal G-bundle with structure group 
Smps, the vertical subspace N'"^' is isomorphic to the Lie algebra Smps of the structure group. 
We obtain 

7V-1 N-1 
n=l n=l 

We can define a map ?\f: Smps Ver TA^p^: x = {a;(n)}n=i,...,Ar-i J^[x] with 

y^A[x]=J2WAm—-eN^^^ (80) 

n=l ^ ' 

and components given by 

^\\x\{n) = A'{n)x{n) - x{n - l)A'{n). (81) 
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The vector field [N"[x] acts as an infinitesimal generator for the group action of G = exp(x). 
Hence, any vertical tangent vector B G N^"^] corresponds precisely to one element x G Smps 
via B = 3\f^[x]. We can then define the horizontal subspace as the kernel of a principal 
connection, which is defined as a Lie-algebra valued one-form u such that ua P^a[x]] = x 
for any x G Smps and any A G ^mps- In addition, a principal connection has to transform 
equivariantly, which requires that 



(82) 



for any B G TaA^p^ = Amps, where for any x G 5mps and any G G Smps, we have introduced 
the adjoint map Ado using the prescription 



Adc [x] = {G{n)x{n)G{ny^} 



n=l,...,N-l- 



(83) 



The principal connection defines an Ehresmann connection as z/^[-B] = K^[(X'yi[-B]] which is 
called a principal Ehresmann connection. The equivarience property of the principal con- 
nection implies that the horizontal lift to the horizontal subspace Bt"^' = kercuA can be inter- 
preted as a section (a continuous right inverse) of the restricted map d^ : (T^mps)/Smps 
TA^MPS- This restricted map can be given the structure of a fiber bundle and is called the 
bundle of principal connection^, since there is a one-to-one mapping between sections of 
d\E': (T^mps)/Smps ~^ ^-^mps and principal connections. 

It can be checked that the following definition of u^^^ satisfies the two conditions required 
in order to be a principal connection: 



in) 



m=l 

n 



m=l {sk} 



s 

^^m+i(^ + l)1'A'''"(m)1'/(m - 1) 
X B"*™ (m)yl''™+i (m + 1) ■ ■ ■ A'' (n) 



n=l,...,Ar-l 



(84) 



n=l,...,N-l 

To prove the equivariant transformation behavior of uj^^\ one should use that for A ^ A^'^\ 
I i— /['^l with /['^](n) = G{n)H{n)G{n). The horizontal subspace is defined by these B such 



that uj'"'^\b) = 0. Using the positivity of the virtual density matrices l{n) defined in Eq. (60) 
and of the maps £, we obtain that tangent vectors i? G B'"^' satisfy 

^ (/(n- l)|Ef = 0. (85) 



Vn 



AT-i: A'{n)H{n-l)B'{n) = 



36 



Geometry of Matrix Product States 




FIG. 2. Illustration of the tangent map $ at base point A. In parameter space AmpSj there is 
a vertical subspace N'^^ of vectors tangent to the gauge orbits (red line). A unique parameter- 
ization of vectors |<I>[-B;^]) in the MPS tangent space T],j,[^]^A^mps requires the definition of a 
complementary horizontal subspace B'"^! (green plane). If this horizontal subspace is defined as the 
kernel of a principal bundle connection, then it transforms equivariantly according to the adjoint 
representation. 



We can summarize this construction in a language that is more familiar to physicists, and 
in particular to the DMRG community. The representation $ of MPS tangent vectors is 
invariant under the multiplicative group action \^[B; A]) = \^[B^^^; A^^^]). Having fixed this 
gauge freedom by selecting a fixed representation A for the base point |\[^[y4]), an additional 
additive gauge invariance remains, since |<I>[-B;A]) = + [Nf^[x]; A]), where !N^[x] was 

defined in Eq. (80). Because of the linearity of $ with respect to B, this boils down to 
the statement that |$[[N"^[x]; A]) = 0, which can easily be checked by explicitly substituting 
the definition of 3^1^ [x] in the definition of $ and noticing that all terms cancel. At a fixed 
value of A, we thus need a set of gauge fixing conditions to link a physical vector \^[B; A]) 
to a unique representation B, which can then also be called a canonical representation. In 



particular, if B satisfies the left gauge fixing conditions of Eq. (85), it can be said to be 
in the left canonical form. The gauge fixing of the tangent vectors boils down to a vector 
space decomposition and is therefore much simpler than the gauge fixing of the original 
MPS. Unlike the left canonical form for the representation A of the MPS there is no 

residual gauge freedom left by the gauge fixing conditions for B and the left canonical form 
is unique. 
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We can also define an alternative yet equally valid principal connection co^^'' via the 
prescription 

N 



<>(B) 



m=n+l 
N 



■ ■ ■ £(™^i) 



r[n 



,-1 



n=l,...,Af-l 



- ^ A"" {ny ■ ■ ■ A^'"-! [m - lyB""" {myr{m) 

in=n+l {sf.} 



(86) 



n=l,...,Af-l 



The horizontal subspace B'^' defined as ker contains vectors B that satisfy 



Vn = 2,...,iV: B'{n)r{n)A'{ny = ^ E^|r(n)) = 



(87) 



which are henceforth referred to as the right gauge-fixing conditions. The vectors B satisfying 
these conditions are said to be in the right-canonical form. 

Finally, we can directly construct the transformation K^[a;] G N^"^] that transforms a 
general element B E Amps into a new representative B = B + G M^^^ satisfying 



e.g. the left gauge fixing conditions in Eq. (85). Starting for = 1, we obtain -B*(l) 
B'{1) + A'{l)x{l). Imposing 



A'{1)H{0)B'{1) = 



results in 



91 



X 



s=l 



If we have now imposed the gauge fixing conditions for all n = 1, . . . , m — 1, which has fixed 
the values of x(l) to a;(m — 1) completely, we obtain B^{m) = B'^{m) — x{m — l)A'^{'m) + 
y4^(m)x(m), where x(m) can be used to impose the gauge fixing condition at n = m, resulting 
in (Vm = 1,...,A^- 1) 

Qm 



x[m) 



-l{my^ J2 A'{m)U{m - 1) (^B'{m) - x{m - l)A'{m)^ . 



This result is of course trivial, as it corresponds to x = — Note that for n = N, we 
cannot impose the left gauge fixing condition. Similarly, we cannot impose the right gauge 
fixing condition for n = 1. Since the overlap between the MPS and one if its tangent 
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N 

(^P]|<f[5]) = E(^(^-l)l<n)I^W)' (88) 
n=l 

the right hand side is a gauge-invariant expression. By imposing the left gauge fixing con- 
ditions, it reduced to (^[]4]|$[fi]) = T^lZi^'WHiN - l)B'{N)r{N) with r{N) = 1, so 
that imposing the left gauge fixing condition for n = N would result in restricting to the 
subspace of tangent vectors B such that = 0. This restriction becomes valid 

in the next section, where we discuss the manifold of MPS in the projective Hilbert space 

D. Principal fiber bundle of matrix product states in projective Hilbert space 

In projective Hilbert space P(B.), we can define a class of projective MPS. 

Definition 13 (Projective matrix product states). The variational class of projective MPS 
corresponds to the map 

P{m): A^^{A) ^[\^[A])] (89) 
with [|\E')] the ray of states containing |\E'). The corresponding variational set is given by 

M MPS = {^(^), ^ £ -^MPs}- (90) 
For obvious reasons, we have again restricted to the submanifold of full-rank MPS ^mps- 
For any A E Amps, we also have XA = {XA{n)}n=i^,,,^N G ^mps ior any A G C. Since 
|\l/[Ay4]) = |\l'[yl]), we have \E'(AA) = ^{A) and we can define a larger structure group for 
which ^ is invariant. 

Definition 14 (Structure group of projective matrix product states). The structure group 
Smps of projective MPS is defined as the product group 

Smps = GL(1,C)xSmps, (91) 
where GL(1,C) corresponds to the group of normalization and phase changes. According to 
Lemma [sj this is a complex Lie group with dim Smps = dim Smps + 1- The right action of 
Smps on ^mps is given by the map 

r : ^MPS X Smps ~^ ^mps '■ 

{A; (A, G)) ^ t{A, (A, G)) = XT{A, G) = XA^^^ = A^^^'^^\ (92) 
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It can easily be checked that the additional GL(1, C) group does not change the properties 
of the group action, i.e. just as F is the new action F a holomorphic, free and proper group 
action. Hence, we can reiterate all the results from Subsection IIIB| in order to obtain 



Theorem 15. The variational class of projective MPS^ : Amps A^mps is a principal fiber 
bundle with structure group Smps? base manifold A^mps; total manifold ^mps O'nd bundle 
projection \E'. The variational manifold M-y^-po, is a complex manifold embedded in P{M) that 
is biholomorphic to the orbit space ^mps/Smps o'^'^ thus has dimension 

dim TWmps = dim^MPS - dimSMPS = dim A^mps - 1- (93) 

The proof is obtained as a straightforward generalization of the methods and results used 
in Subsection IIII B[ 

Correspondingly, we now study the tangent map d\^: TA^^^ — t- TM.^-p^. Since the new 
structure group Smps is one dimension larger then Smps, the corresponding Lie-algebra Smps 
has also gained an additional dimension corresponding to 

5mps = SKI^C) ©5mps (94) 

with C) = C. To each element (a, x) G 5mps corresponds a vertical vector field ^[(a, x)], 
for which the components of !N"A[(a,x)] G N'"^' at base point A are given by 

WA[{a,x)]{n) = A'{n)x{n) - x{n - l)A'{n) + aA'{n). (95) 

Note that + ^^[(a;, a;)]]) = \^[B]) + aA^|\I^[A]), which is not a contradiction since 



MPS' 



T[|^[A])]A^MPS = ^*>A1mps/ ~5 where for any two vectors , |'^'[-B2]) G T\^[a])M 

MBi]) ~ |$[S2]) if MBi]) - |$[S2]) = /3 for some /3 G C. We can easily construct 

two principal connections a)'-^-* and a}'-^-' using the prescriptions 

' \N {^^J[A]\^A])' {^[A]\^[A]) ^ ' 



and 



It can easily be checked that ^^'^■'(^^[(a, x)]) = (a,x) and 



^i[;?c),(i^'^''^^^) = Ad(.,a)- (98) 



r,(L,R) 
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where the components of ijK-'*''^)! are given by (B^'^^'^^'')^ (n) = XG{n — 1) ^B^G{n), where 
{X,G)~^ = {X^^,G^^) and for any (a, x) G Smps we have 

Ad(A,G)[(a,x)] = KAdcM). (99) 

The horizontal subspace B'"^' is now defined by the vectors B satisfying u}^^\b) = or 
oo^^\b) = 0. Hence, for both choices of the connection, the horizontal bundle Bt^^J contains 
these vectors B for which (^ffA] |<I>[_B]) = 0. We thus obtain 

'I'mPS - T[\-i[A])]MMPS - '^MPS' (100) 

with t{^p"^ the orthogonal complement of in T^^pg. A full characterization of the 

vectors B G B'^' is given by 

cdJ)(5)=0 ^ \/n=l,...,N ■.A'{n)U{n-l)B%n) = Q (101) 



or 



uf\B)=0 ^ Wn = l,...,N : B'{n)r{n)A'{n)^ = 0. (102) 



We can now also reinterpret the construction from Subsection |II E| of the previous section 
in terms of a fiber bundle structure. The vector field v^{z)di corresponds to the vertical 
subbundle and generates the group action of GL(1, C), the group of normalization and phase 



changes. The condition in Eq. (39) follows from defining a principal Ehresmann connection 
in order to define a unique horizontal lift of tangent vectors in T^i^j^]) to the horizontal 
subspace of (T,C™)+ ^ C™. 



E. Fullback metric and efRcient parametrization 

We have finally arrived at the point where we can induce the natural metric of EI or P{M.) 
onto A^MPS or A^mps respectively, transforming these manifolds into Kahler manifolds, 
followed by a puUback of this metric to ^mps- Throughout this section, we discard the 
notation of [A] in all quantities depending on it. 
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The entries of the metric g are imphcitly defined by the following A^^ terms: 



N 



n,n'=l 

N / n'-l \ 

= (/(n-i)iE^<:; n EjK'iK"')) 

n<n'=l \m=n+l / 

N / n-1 \ 

+ y: «"'-i)iE;;siM n i^iS,]K>M) 



(103) 



n'<n=l \m=n'-\-l 

N 

+ 5^(/(n-l)|E5(";|rH). 



n=l 



where the definitions in Eq. (59) and Eq. (60) were used and we use a summation convention 
with respect to the collected indices i = (a, s,f3), but not with respect to the site index n. 
The metric is thus a complicated matrix of size dim Amps dim Amps, that couples all 
variations B{n) and B'{n') at different sites n and n' . Straightforwardly, it is degenerate, 
since any 5 G N results in 

N 

^ 9{n,ty,in',j)B^ {n') =0, Vn = 1, . . . , A^, V« = 1, . . . Dn-iqnDn- 

n'=l 

It is, however, positive definite, when restricted to the horizontal subspace B, so that we can 
define a pseudo-inverse metric such that 

N 
n'=l 

where Pb is a projector onto the horizontal subspace B such that ker = N. Using 
a principal connection u we can define a projector to the vertical subspace with the 
horizontal subspace B as kernel, by defining 

N 

(^N)^"t, ,) B^{n ) = J<A [u^a[B]] = ua[B], (105) 

ra'=l 

SO that Pn corresponds to the matrix representation of the principal Ehresmann connection 
u associated to u. The projector Pb for the horizontal subspace can then be written as 

Pb = Iamps - ^N- (106) 
However, due to the complicated structure of the metric, it seems like an impossible task 



to explicitly compute a pseudo-inverse satisfying Eq. (104). This problem could be solved 
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by using an iterative implementation, but the evaluation of ($[-8] would still scale as 

0(A^^), which is also very unfavorable. However, for the horizontal subspace B defined by 
either co^^'^ or u^^\ the vectors B eM satisfy either the left or right gauge fixing conditions 



Eq. (85) or Eq. (87) respectively, and in both cases the overlap ($[-8] simplifies 
significantly to 



N 



{mmB']) = J2^Kn-i)Ki:^\r{n)) 



(107) 



n=l 



and all non-local terms that couple B{n) with B'{n') at different sites n = n' are eliminated. 
Below, we construct a representation of tangent vectors i? G B in such a way that the metric 
is equal to the identity. 

We first consider the modifications that arise when working with the projective manifold 
A^MPS C P(EI) instead. We can implicitly define the puUback g of the Fubini-Study metric 
to ^MPS as 

N 



n) g(n,i);(n',j) 



B'in'V 



[mmB]) {^BmA]){nmm 



n,n'=l 



mA]\m]y 



(108) 



where all quantities in the right hand side have been explicitly defined above. When working 
with vectors B eM, where the horizontal subspace has been defined by either u^^^ or 



-1 



the right hand side essentially reduces to Eq. (107), up to the overall factor (\E'[y4] |\E'[y4]) 
which can be set to 1 by properly normalizing the MPS A pseudo- inverse metric is 

then completely characterized by 



TV 



g{n',-Mn",k) - (-Pfi) 



(n,i) 

{n",k) ■ 



(109) 



n'=l 



The simplification of the metric g in Eq. (107) is only useful if we have an efficient 



algorithm for imposing the left of right gauge fixing conditions in Eq. (85) and Eq. (87) 



respectively, or Eq. (101) and Eq. (102) in case of the projective metric g. Even better is an 



efficient algorithm to construct gauge-fixed representations B in the horizontal subspace B 
or B from the smaller number of truly independent degrees of freedom. Let us start with the 
projective case. It is indeed easy to find a linear parameterizatioiJ^ B = S[X] depending 
on a set X = {X{n)}n=i,...,N of complex {qnDn^i — Dn) x Dn matrices X(n), where !B[X](?7,) 
depends only on X{n) (locality), so that 23 [X] satisfies the left gauge fixing conditions 
[Eq. (101 )] for all n = 1, . . . , iV. In fact, we can even further simplify the metric and convert 
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it into the unit matrix. We thereto define the set L = {L{n)}n=i,...,N of Dn x qnDn-i matrices 
L{n) as 

[L(n)]„;(,^) = [A^{n)H{n - if^X^^ (110) 

and then construct a set Vl = {VL{n)}n=i,...,N of qnDn-i x (qnDn-i — Dn) matrices VL{n) 
so that Viln) contains an orthonormal basis for the null space of L{n), i.e. L{n)VL{n) = 
and VLinyViin) = lg^D„-i-Dr„ for all n = 1, . . . , A^. Setting [^/(n)]^,,/^ = [VLin)](^say,i3, we 
then define the representation as 

'B'[X]{n) = l{n - l)-^/V/(n)X(n)r(n)-^/2 (111) 

in order to obtain Y^%iA'{n)H{n - l)S[X](n) = 0, Vn = 1, . . . , A^, and 



N 



($[S[X]]|$[S[y]]) = ^tr [X(n)ty(n)] . (112) 



n=l 



Hence, when expressed in terms of the matrices X, the covariant and contravariant compo- 
nents of a vector are identical. An alternative representation B = !B'[X'] in terms of a set 
X' = {X'{n)}n=i,...,N of complex -D„_i x {qnDn — -Dn-i) matrices X'(n) can be constructed, 
so that B = !B'[X'] lies within the horizontal subspace defined by i.e. the matrices 



B^{n) satisfy the right gauge fixing conditions [Eq. (102)]. Define hereto the qnDn x -D^-i 
matrices R{n) as 

[R{n)](^a,s);(S = [r{nY/'A'in)%,p (113) 

and then construct a (g„D„— i5„_i) x q„D„ matrix Vji{n) so that V^lnY contains an orthonor- 
mal basis for the null space of -R(n)^, i.e. VR{n)R{n) = and VR{n)VR{ny = lq„D„-z)„_i, 
for all = 1, . . . , X. Setting [V^(?T-)]a,/3 = [VR{n)]a-{i3,s), the representation !B'[X] is defined 
using the prescription 

(S7[X](n) = l{n - l)-i/2^(n)l^^(n)r(n)-i/'. (114) 
Finally, when using the pullback g of the affine Hilbert metric, we can only impose 



e.g. the left-gauge fixing conditions [Eq. (85)] for n = 1, . . . , X — 1. The non-zero value 
of T.lZiA'{Nyi{N - 1)B'{N) determines the overlap (^[A]|<l>[5]). We can then use a 
representation B = !B[(a,X)] depending on a set X = {X(n)}„=i,...,Ar of complex {qnDn-i — 
Dn) X Dn matrices X{n) and a complex scalar a, where 

!B^[X](n), n<N, 
S1(a,X)](n) = <; ^ ^ _ " ^ A^jN), n = N. ^^^^^ 

{nAmA]f' 
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We thus have X)]) 



amA]\^[A]) and 



AT 



(116) 



n=l 



Note that we can now also understand why we took the effort of reducing the parameter 
space from the simple vector space Amps to the more complicated manifold .Amps- If a 
point A G Amps one of the virtual density matrices l{n) or r(n) do not have a full rank, the 
metric g or g has additional zero eigenvalues, i.e. its reduction to the horizontal subspace is 
still degenerate. Hence, these rank-decifit points really correspond to the singular points of 
the set Vmps- The open set A^mps is obtained by precisely removing these singular points 
from the set Vmps- Given the definition of a metric and its (pseudo)-inverse, we can then 
go on to define a Levi-Civita connection and a Riemann curvature tensor, as was sketched 
in the previous section. We have now reached the point where it is important to emphasize 
the difference between the Levi-Civita connection, which is an intrinsic property of the 
vector bundle TA4^p^ and follows from the geometry induced by its embedding in Hilbert 
space, and the principal connection, which is defined for the bundle map d^: TA^po^ — >■ 
TJH^pg, and allows one to lift quantities in TA^jJ^pg to TA^^pg. In particular, the principal 
connections defined above allow to lift the Levi-Civita connection from TM^p^, and thus 
to define it in terms of the coordinates of T^^pg. 

Generic MPS have the property that the map \E' is multilinear, i.e. it is linear in each 
parameter. Every line parallel to one of the coordinate axes in Amps is mapped to a straight 
line, and thus to a geodesic, in the affine Hilbert space H. Hence, the variational man- 
ifold A^MPS is a ruled surface, where the tangent vectors along the rules constitute an 
(over) complete basis, since there is a rule corresponding to every coordinate axis in Amps- 
This fact was used in Ref. |W to study the curvature properties of variational manifolds 
defined by multilinear maps in a general setting, and it was shown that the sectional cur- 
vature of the resulting manifolds is always negative. We therefore restrict our discussion of 
the Levi-Civita connection and the Riemann curvature tensor to uniform MPS, which are 
defined in the next section, and for which the defining map does not have the multi-linearity 
property. 
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IV. GEOMETRY OF UNIFORM MATRIX PRODUCT STATES 

Because many interesting physical systems are of macroscopic size, one is often interested 
in the bulk properties of these systems, far away from any physical boundary. In addition, 
the main interest is often in systems which are translation invariant. These requirements vote 
in favor of systems with periodic boundary conditions, where there are no boundary effects 
— only finite-size effects with nice scaling behavior — and translation invariance can easily be 
reproduced. On a lattice with periodic boundary conditions (where translation invariance 
of the models dictates a site- independent g„ = g), a translation invariant subclass of MPS 
can be obtained by choosing the bond dimensions Dn = D site-independent and using a 
translation invariant representation, i.e. by choosing the matrices to be site- independent: 

= y4**, Vs = 1, . . . , g, = 1, . . . , A^. The resulting variational class is called the class of 
uniform matrix product states Vumps(d) C Vmps{d„=z)}- Note that a general (translation non- 
invariant) gauge transformation will ruin the translation invariance of the representation. 
The only allowed gauge transformation in Aumps(d) is a global transformation with site- 
indepedent matrices G{n) = G, Wn = 1,...,N, where G G Gumps(d) = GL{D;C). Vice 
versa, a translation invariant MPS might only have a representation as a uMPS after a 
suitable site-dependent gauge transform. In addition, some translation invariant MPS do 
not allow for a translation invariant representation without enlarging the bond dimensionSD. 
Thus, VuMPS(D) does not contain all translation invariant states of Vmps{d„=d}- 

A. Uniform MPS as principal fiber bundles 

Throughout this section, we are dealing with uniform MPS, for which we do not invent 
new symbols. However, the functional dependence on a single tensor A rather than a col- 
lection of site-dependent tensors A = {A{n)} is denoted by using round brackets ( ) instead 
of square brackets [ ]. 

Definition 15 (Uniform MPS). Let a uniform MPS (uMPS) on a lattice £ = {1, . . . , V} 
with a local site dimension q and periodic boundary conditions be defined as a holomorphic 
map 

q q 

^ : KupsiD) ^Mc-.A^ l^iA)) = ■ ■ ■ tr [A^^ ■ ■ ■ A'^] \s1S2 ...sn), (117) 
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with AuMPS(z)) = C^^'^-^. Henceforth, we discard of the exphcit notation of (D) in Aumps- 
The image of the map \I/ is defined as the variational set 



In the evaluation of physical expectation values, an important role is played by the 
transfer matrix E = = Yll=i ^'"^ ® associated completely positive maps £ 

and £, all of which are now site- independent. The transfer matrix E has eigenvalues 
^(k) = 1^ . . . and corresponding left and right eigenvectors which we denote as (/'^'^•'l 
and \r^^^) E ® . They correspond to linear operators l'^^\r'^^^ E L(C'^), with 
being the ancilla space, and are related to the associated maps by £(r*^'^)) = z^'^h-^'^'^ and 



£(/W) = ^W/W. 

As mentioned in the introduction, the physical state |\E'(A)) is unchanged under the the 
right group action T : Aumps x GuMps -> Aumps: r(y4, G) = T^'-'\A) = A^*^) defined by 



where Gumps — GL(D,C). It can easily be seen that the center subgroup GL(1,C) = 
{cl£)|Vc E Co} is within the stabilizer subgroup G*^"^) for any A E Aumps- Hence, we 
can define a quotient group 



with PGL(Z},C) the projective linear group. We denote elements of Sumps as [G], with 
[G] = G'GL(1,C) = {cG\c E Co} the coset of the normal subgroup GL(1,C) C GL(D,C). As 
in the previous section, we have to restrict to some open subset ^uMps C Amps in order to 
ensure that the group action 



r : Amps x S.mps ^ Amps : {A, [G]) ^ T{A, [G]) = A^^) (for any G E [G]) (121) 



is free and proper. Naturally, the definition above is independent of the choice of G within 
the coset [G]. In order to characterize the subset Amps, "we recall some known decomposition 
results for uniform MP^^. 

As in the previous section, we start with tensors A E Aumps such that the qD x D matrix 
^{as),i3 = p ^ matrix Wct,(si3) = 13 havc maximal rank, i. e. rank D. If this 

were not the case, the uMPS |^l/(^)) could be written as a uMPS |^^(^)) with lower bond 



VuMPs = {|^(A)) ,VA E Amps} C H^. 



(118) 




(119) 



Sumps = G,mps/GL(1, C) = PGL(D,C) 



(120) 
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dimension D < D. However, this restriction is in itself insufficient for the case of periodic 
boundary conditions. Under the full rank condition, the D x D matrices have a block 
decomposition into J > 1 blocks as 



A' 



XiAl 
AaA^ 








(122) 



where A^ are matrices of size Dj x Dj,yj = 1, . . . , J, with Ylj=i = D. The corresponding 
matrices {yj)(^as),i3 = (^j)a,/3 ^"^^ matrix (Wj)oi,(si3) = (^jOa,/? have rank Dj. The coefficients 
Xj satisfy < Aj < 1 and are chosen such that the corresponding transfer operators Ej = 
J2l=i A] ® A^ have 1 as eigenvalue with largest absolute value. The block decomposition 
is constructed such that this eigenvalue is non-degenerate for each block. The remaining 
gauge invariance within the blocks can be used to bring the blocks Aj into a specific format. 



such as e.g. the right canonical form of Subsection IIIB 



• 'Yl'i=iAfljA'^- = = Ij where Ij is a diagonal matrix with strictly positive eigen- 

values. 

The block decomposition states that the uMPS |\I^(y4)) can be written as a superposition 

MA))=J2^f\'^Mj))^ (123) 
i=i 

where |\&j(y4j)) G A^uMps{z)j) is a uMPS with lower bond dimension Dj < D. Let us now 
relate this block decomposition of A G Aumps to the stabilizer subgroup G*^^^ As mentioned 
before, the stabilizer subgroup certainly contains the subgroup GL(1,C). If A has J > 1 
blocks in its block decomposition, it is immediately clear that there exist additional gauge 
transformations G = ^j^iCjlD^ with cj G Cq for all j = 1,..., J within the stabilizer 
subgroup G'-^^ Let us now restrict restrict to those uMPS A which have a single block 
within the block decomposition. Up to a normalization, the spectral radius p(E) = 1 
and the transfer operator has a unique eigenvalue z^^^ = 1 with corresponding left and 
right eigenvectors l^^^ and r^^^ that have full rank. It can be shown that E then has P 
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eigenvalues 2;^^-* {p = 1,...,P) that are evenly distributed on the unit circle, i.e. z 



(p) 



exp(i27r(p - 1)/P) = zl''^ with z^ 
periodic decomposition., is possible: 



A' 



exp(i27r/P). A further decomposition, called the 




A| 



Af, 



(124) 



where is a matrix of size -Dp-i x Dp with Dq = Dp and ^^^^ -Dp = -D- The eigenstates 1^'^^ 
and r*^^) corresponding to the eigenvalues z^^^ {p E Zp) of unit magnitude correspondingly 
decompose into 

{z^P^f'hi ■■■ 
{z^P^'^k ■■■ 



1(P) 











rp 



(^(p))^ Vi 



••• ip 






125a 



(125b) 



3 ••• {z^P^)rp^i 

where ELi ^^^p^^ = Ui ^ C^-><^'' and ELi ^p^p^? = ^p-i ^ C^--i><^''-i (Vp G Zp). If 
P is a factor of A^, the state |\l/(y4)) can be written as 



(126) 



where |^I/[v4]) G M.mps{d„} ^ non-uniform MPS with A^{n) = mod p = 
Dn modP- The state \^[A]) is thus P-periodic (T^ |^[^]) = |^[^])) and |^(A)) is a trans- 
lation invariant superposition of |\1'[A]) and its shifted versions. If P is not a factor of N, 
\^{A)) = 0. 

The set of injective uMPS ^uMps C Aumps is given as those uMPS A for which z'^^'^ = 1 
is the only eigenvalue with modulus 1, i.e. P = 1 in the periodic decomposition of A. All 
other eigenvalues are then situated within the unit circle. This condition is also required in 



order to obtain an unambiguous thermodynamic limit in Subsection IV B The nomenclature 
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{i.e. injective) is clarified at the end of this subsection. A gauge-invariant definition for the 
subset ^uMPS C AuMPS of injective uMPS that does depend on a particular canonical form 
or a particular normalization such as p(E) = 1 can also be given. 

Lemma 16. The set of injective MPS injective uMPS ^uMps defined as 

Amps = {A e A.mps I p(E - z^''^\r^''^){l^''^\) < p(E) and rank(/(^)) = rank(r(^)) = D} 

(127) 

where z^^'^ is any eigenvalue of largest magnitude of the transfer matrix E associated to 
A (it is unique for A E ^uMPsj? o,'>T'd \r^^^) and are the corresponding right and left 

eigenvectors, is a complex manifold with dim^uMPS = dimAuMPs = qD^. 

Proof. According to Lemma [TJ it is sufficient to prove that ^uMps is an open subset of 
AuMPS- Since z^^^ is a non-degenerate eigenvalue, its value and associated eigenvectors 
change continuously under arbitrary small perturbations, so that the non-degeneracy and 
the full rank condition on the eigenvectors are also preservecP^. Hence, for any A G ^uMps, 
there exist an open neighborhood of A contained in ^uMps- Alternatively, one can argue 
that the complement ^uMps in Aumps satisfies conditions which make it a closed set. □ 

Having characterized the complex manifold ^uMps? we can now study the restriction of 
the group action to ^uMps- 

Lemma 17. For any A E ^uMPS; ^he stabilizer subgroup G^"^^ with respect to the group 
action o/Gumps is exactly equal to the center group GL(1,C). 

Proof. For any A E ^uMPS? the corresponding transfer operator E has a non-degenerate 
eigenvalue z^^^ for which the corresponding eigenvectors l^^^ = I and r^^^ = r have full rank. 
Since G E G*^^^ implies that A^'^'' = A, we obtain 

E\Gr) = z'-^^\Gr), 

so that Gr is proportional to the r. Hence, the only elements G of the stability group 
satisfying this relation are G = do & GL(1, C). □ 

Hence, by trading the full gauge group Gumps for the quotient group Sumps = PGL(C, D), 
we obtain the following result: 

Corollary 18. The group action F : ^uMps x Sumps — > ^uMps is free. 
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Note that the proof above only requires a non-degenerate eigenvalue with corresponding 
full rank eigenvectors. Hence, the group action T : ^uMps x Sumps ~^ -^umps is free for all 
uMPS A which have a single block in the block decomposition (J = 1), even if this block 
corresponds to P > 1 in the periodic decomposition. However, for P > 1, there do exist 
non-trivial translation non-invariant gauge transformations {i.e. with site-dependent G{n)) 
that have no effect on the uMPS. In addition, the restriction to uMPS A with P = 1 is 
required below in order to have a natural notion of injectivity. 

Lemma 19. The group action F : ^uMPS x Sumps ~^ -^uMPS is proper. 

Proof. As in the previous section, we use Theorem [9] to prove this result. The group action 
r : ^uMPS X SuMPS -4uMPS naturally fulfills the conditions of Theorem |9] if we can define a 
distance function that is invariant under the action of Sumps- The following distance function 
meets this requirement: 

D,MPs(^o,A)=min / (/(t)|E;j;;;|r(t))dt (128) 

Mi) Jo ^ ' 

where A : [0, 1] — )► ^uMps '■ t ^ ^(t) is a piecewise smooth path with A{0) = Aq and 
A{1) = Ai, and l{t) and r(t) are a left and right eigenvector corresponding to the largest 
eigenvalue of IE^||| and are normalized as tr[/(t)r(t)] = 1. Given the conditions on the subset 
.AuMPS of injective uMPS, the integrand is strictly positive for nonzero A(t), so that any two 
distinct uMPS Ao and Ai result in _Dumps(^07 ^i) > 0. It is straightforwardly checked that 
-DuMPs(^o,^i) = -DuMPs(^o ) fo^^ any [G] e Sumps- The distance function -Dumps can 

only be related to a (rescaled version of) -Dmps in the thermodynamic limit, as is explained 
in the next subsection. □ 

We now have all the necessary ingredients to prove the main theorem of this section: 

Theorem 20. The variational class of injective uMPS \E' : ^uMPS A^uMPS can he given 
the structure of a principal fiber bundle with structure group Sumps? ^ose manifold A^uMPS; 
total manifold .Aumps one? bundle projection \E'. The variational manifold A^uMps o com- 
plex submanifold ofM. that is biholomorphic to the orbit space ^uMps/Sumps «'t-<^ thus has 
dimension dim A^mps = qD^ — D"^ + 1. 

Proof. As in the previous section, this theorem depends strongly on the general results 
stated in Theorems [TT] and [12] and Lemma [131 These theorems allow to conclude that 
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-4.uMPs/SuMPS is a complex manifold and that \1/ : ^uMps A^uMps factorizes as ° 
with 71 : ^uMPS -^uMPs/SuMPS the natural holomorphic projection. In order to make any 
statements about the nature of A^uMps, it remains to be proven that '■ -^uMps/SuMps 
A^uMPS is a biholomorphism. The holomorphic map ip is surjective by definition. Hence, 
it remains to be proven that it is injective, i.e. that the uMPS representation of a state 
is unique up to the action of the gauge group for any A G ^uMps- It was proven in 
Ref. 25] and HH that the defining properties of v4umps are sufficient to obtain a one-to-one 
correspondence between A and |^'(a4)), hence justifying the name injective MPS. In fact, 
the result is even stronger, since A is completely defined (up to gauge transformations) by 
all reduced density matrices pe = tYc\e {"^{A)) {"^{A)] for any contiguous block of sites i that 
is longer than a certain minimal length io, called the injectivity length. □ 

As in the previous section on generic MPS, we can similarly define a manifold AIuMps C 
P(M) and define it as the base space of a fiber bundle with bundle space .Aumps and an 
enlarged structure group Sumps that also includes norm and phase changes. We will explicitly 
do so when discussing the thermodynamic limit in the next subsection, where this becomes 
the most natural structure to look at. 

B. Thermodynamic limit 

Despite the nice properties of systems with periodic boundary conditions, the increased 
computational complexity of evaluating expectation values with respect to MPS with pe- 
riodic boundary conditions has hindered their applicability. This increased computational 
complexity is caused by the fact that correlations between two points can travel along two 
different ways on the circle. In contrast, systems with open boundary conditions can have 
strong boundary effects (Friedel oscillations) that extend deeply into the bulk, especially 
for (near)-critical systems. However, for very large systems — which are finite-size restric- 
tions of translation invariant Hamiltonians in the thermodynamic limit — we still expect the 
matrices of the MPS approximation of the ground state to become site- independent when 
sufficiently far from the boundaries. By exploiting the translation invariance in either a MPS 
with periodic boundary conditions or in the bulk of a MPS with open boundary conditions, 
we can directly define a uniform MPS representation in the thermodynamic limit. The com- 
putational disadvantages of the MPS with periodic boundary conditions disappear, since 
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observables with compact support cannot distinguish between open or periodic boundary 
conditions. On the other hand, boundary effects are also undetectable by operators that live 
deep in the bulk. We can therefore discard them and restrict to the translation invariant 
bulk of a system with open boundary conditions. 

A quantitative verification of these statements requires the definition of the class of uMPS 
|\E'(yl)) in the thermodynamic limit. Starting with a system on the lattice L = {—N, —N + 
1, . . . , — 1, A^}, this limit is formally obtained as 



q 

\'^(A)) = lim tr 
{s„}=i 



Q n 

n=-Af 



9 



IK})- (129) 



\{sn}) = 5^ tr 

{s„}=l 

The D ^ D matrix Q is a boundary matrix that allows one to interpolate between periodic 
boundary conditions (Q = Id, rank(Q) = D) and open boundary conditions (rank((5) = 1). 
The purpose of this section is to show in a constructive fashion that the subset of elements 
A G AuMPS that have a well-defined thermodynamic limit — in the sense that normalized 
expectation values of local operators do not depend on the boundary conditions encoded 
by Q — corresponds exactly to the set ^uMps- Note that the limit in the definition above 
is only valid at a physical level, and a more rigorous treatment would inevitably require 
the introduction of C*-algebras. Such a rigorous study of uMPS |\I'(y4)) has been done by 
Fannes, Nachtergaele and Werner in Ref. [15], who refer to these states as finitely correlated 
states. The class of finitely correlated states is even more general, and the subclass that 
corresponds to the uMPS are the so-called purely generated finitely correlated states. When 
the transfer matrix E has a unique eigenvalue 1 (z.e. J = 1 in the block decomposition), the 
state is called ergodic, and when this is also the only eigenvalue with modulus 1 (z.e. P = 1 
in the periodic decomposition), the state is called a pure finitely correlated state. Unlike the 
ordinary MPS |\E'[A]), which is linear in each of its arguments A{n) separately, the uMPS 
[^'(A)) is highly non-linear in its argument. It took some major breakthroughs before an 
algorithm was constructed that allowed the variational optimization of the uMPS ansatd^. 



The norm of the state in Eq. ( |l29[ ) is given by {^{A)\^{A)) = lim^_^ootr[(Q®Q)E2^+i]. 
We can always rescale A such that the spectral radius p(E) = 1 and |\1'(/1)) becomes 
normalizable to some finite value. However, by only looking at normalized expectation 
values and defining everything in terms of the limit A^ — > oo, this is not really necessary. 
Let z^''^ for k = 1, . . . , K he the eigenvalues with largest magnitude, so that l^;^'^-' | = p(E), and 
denote the corresponding left and right eigenvectors as \ and |r*-'^-'), which are normalized 
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as (Z^'^^jr^*^)) = 1 so that S^'^) = is a projector onto the corresponding eigenspace. 

At least one eigenvalue is positive, and we label it with A; = 1, so that z'^^^ — p(E). For the 
normalization of the state, the only terms that survive the limit are given by 

K 

(^M)|^M))= lim y(^(^¥^+V/('=)|g®g|r('=)). (130) 



k=l 



If a product operator O has non-trivial support only on the sites {— M, — M + 1, . . . , +M} 
with M some constant, then the correlations acting along the other side of the circle have 
to travel over an "infinite distance" in the limit N oo. Here too, only the terms corre- 
sponding to the eigenvalues z^'^^ {k — 1, . . . , K) survive, resulting in 



K 



X (Z(*^)|Eo(_M)Eo(_M+i) • • • Eo(M)|r('=^). (131) 



k=\ 



We can thus define the normalized expectation value as 

^ ' (^(A)l^(yl)) iv-^oo 
where {Oat} is an infinite sequence with entries 



(132) 



O 



E 



N 



0(M)V 



Ef=i('2^'=))''^+'(^(')|<5®<5|r«) 



■ K 

E 

.A;=l 



27V-2M 



X 



K 



(fe) \ 2JV+1 



(/('') I Eo(-M)Eo(-M+l) ■ • ■ Eci(M) 1^'^''^) 



(zW) 



2M+1 



(133) 



fe=i ^ ^ 



The entries Oat can be computed using the iterative construction for MPS with open bound- 
ary conditions, resulting in a computational complexity Q{KD^\ Since the number of 
eigenvalues K with magnitude p(E) is typically much smaller than ^ the increased com- 
putational complexity of periodic boundary conditions disappears, provided that we can 
efficiently determine the K eigenvalues and their corresponding eigenvectors using an it- 
erative eigensolver. However, unless all K eigenvalues z^^^ equal a unique positive value 
or 

(/(*^)|Eo(_M)Eo(-M+i) ■ ■ • Eo(M)|r(*^') = 
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for all eigenvalues that don't, the sequence {On} is an alternating sequence that does not 
converge so that the limit in the definition of 0{A, A) does not exist. If all eigenvalues z^^^ = 
z^^^ = p(E) for k = 1, . . . , K, the thermodynamic limit is well-defined, but the expectation 
value still depends on the boundary matrix Q. This corresponds to a block decomposition of 
A into J > K blocks, where Xj = p(E) for j = 1, . . . , K and Xj < p(E) for j = K + 1, . . . , J, 
and where in addition the individual blocks Aj have a periodic decomposition with P = 1 for 
j = 1, . . . , K. The MPS is then a superposition of uniform MPS with smaller bond 

dimensions as in Eq. (123), and Q determines the superposition coefficients. Note that the 
blocks with j = K + 1, . . . , J, for which Xj < p(E) are irrelevant in the thermodynamic limit. 
If such blocks are present, the state |\l/(y4)) can in the thermodynamic limit be represented 



by an equivalent uMPS with smaller bond dimension D = Ylf=i^j- Only when 

K = 1 and the transfer operator E has a unique eigenvalue with magnitude equal to the 
spectral radius do we obtain a normalized expectation value (^(A)|0|\1/(A)) / (A)]"^ (A)) 
that is completely independent of Q. We then obtain 

A\ _ (^^^^|Eo(_Af)Eo(_Af+i) ■■■Eo(A/)|rW) 

In addition, we do assume that there are no other blocks Aj with Aj < p(E) (j = 2, . . . , J) 
present in the block decomposition (i.e. we assume J = 1), so that l^^^ = I and r^^^ = r have 
full rank. The resulting subset of uMPS A with these properties corresponds precisely to the 
set ^uMPS- While there is no difference between open and periodic boundary conditions for 
normalized expectation values of local operators if we restrict to A G ^uMPS, we do assume 
we are working with open boundary conditions and denote Q = v-^vl^ in the definition of the 
uMPS and its tangent vectors (see next subsection) accordingly. This assumption simplifies 
the computation of expectation values and allows for certain generalizations that e.g. enable 
the description of topologically non-trivial excitations in Ref. |20l We always assume that 
the transfer matrix E has a non-degenerate eigenvalue 1 as single eigenvalue on the unit 
circle, and no physical expectation value will ever depend on on the left and right boundary 
vectors i>l and v^. 

Note that the central object in the discussion above was the normalized expectation value 
of (local) observables. This quantity can be defined in the whole of Hilbert space M.c and 
is independent of the norm and phase of a given state. Hence, the normalized expectation 
value of a local operator can unambiguously be defined for the elements [|\I')] G P{M.c). In 
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the thermodynamic hmit, it is thus natural to interpret the uMPS representation as the 
principal fiber bundle : v4umps ^ -^uMps given by 

^: Amps ^ -M.mps C P{mc): A ^ (135) 

which is injective up to the action of a structure group or gauge group 

^„MPS = GL(1, C) X Sumps = GL(1, C) x PGL(D, C) (136) 
with right group action 

r : Amps x •S'umps Amps '■ 

(A,(A,[G]))^AA(^). (137) 

It is clear that we can repeat all the proofs of the last subsection, if we also define a 
normalized distance function -Dumps that is invariant under the action of Sumps- Firstly, 
we observe that -Dumps defined in the previous subsection matches with -Dmps defined in 



Eq. (68) in the setting of a translation-invariant thermodynamic limit, up to an overall 
diverging factor limjv-5>oo = Such a diverging factor will be encountered often in the 
remainder of this section. To also obtain invariance under norm and phase changes, we 
modify the distance function -Dumps to 

DuMPs(A,A) =min / dt (138) 

A{t) Jq zW{t) 

with z^^\t) = p(E^|||). With this definition at hand, it is easy to prove that f : Amps x 
'S'uMPS Amps is free and proper and the principal fiber bundle construction still holds. 

We now introduce some notations that are used throughout the remainder of this section. 
We have already introduced the left and right eigenvectors / = l^^^ and r = r^^^ corresponding 
to the unique eigenvalue z^^^ = p(E), which are normalized such that (/|r) = 1. All other 
eigenvalues z^''\ k > 1 satisfy the strict inequality \z^''^\ < p(E). We also define S*-^^ = S = 
|r)(Z| as a projector onto the eigenspace of eigenvalue z^^\ and its complement Q = 1 — S. 
Since physical states are now living within the projective space A^uMps^ we can and often will 
use a point A on the gauge orbit for which p(E) = 1. Put differently, we often 'renormalize' 
A ^ A/^p{E) such that p(E) = 1 for reasons of simplicity, i. e. this allows one to eliminate 



the denominator in the normalized expectation value of operators [Eq. (134)]. Given a set of 



local operators O", we can use these definitions to compute the 2-point connected correlation 
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(139) 



function as 

Y(»'^){n) = (/|Eoc.E"-iEo/3|r) - {l\Eo^\r){l\Eo^\r) 
= (Z|Eo.Q(QEQ)""'QEo/3|r). 

where we have used 

E" - S = QE"Q = Q(QEQ)"Q. 
The correlation length ^ is then determined by the largest eigenvalue of QEQ as 

^ = "log[p(QEQ)]- 

Under the given assumption, p(QEQ) < 1 and the correlation length ^ is finite. Hence, all 
pure uMPS are exponentially clustering. The correlation length is determined by p(QEQ), 
which is equal to the eigenvalue of the transfer matrix E that is second largest in absolute 
value. 

Finally, we compute the normalized overlap between two uMPS as 



p(E 



-|2Af+l 



A 



p(E^)V2p(E^;)i/2j 



(141) 



We can thus define d{A, A') = p(E^)p{E^)~^/^p{E^,)~^/'^ as the fidelity per site between the 
two uMPS |\['(A)) and |\E'(A')). It can easily be shown that this definition is compatible with 
d{A,A') < 1. In addition, under the given conditions for injective uMPS A, A' G ^uMps, it 
was proven in Ref. Il2]that d{A, A') = 1 implies that the two states are equivalent, such that 
there exists (A, [G]) G S^mps for which A' = T{A, (A, [G])) = \A^^\ Ahernatively, d(A, A') < 
1 corresponds to gauge-inequivalent states and implies F{A, A') = due to the orthogonality 
catastrophd^ any two inequivalent injective uMPS are automatically orthogonal in the 
thermodynamic limit. In conclusion, the fidelity (per site) is a useful tool to check whether 
to uMPS A, A' G v4uMPS belong to the same gauge orbit. 



C. Tangent bundles and the principal Ehresmann connection 

As in the previous section, we can now define a bundle map d\E' between the holo- 
morphic tangent bundles T^uMps and TA^uMps- At any point in A G ^uMps we have 
TaAumps = AuMPS = C^^'^^^. While the projective Hilbert space P{Mc) is the most nat- 
ural choice in the thermodynamic limit, it is conceptually simpler to work with the affine 
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Hilbert space H^. We return to the projective setting at the end of this subsection. For 
now, we also define the bundle map d^ : T^uMps ~^ T'AIuMps- As in the previous section, 
we denote T|^(^)) A^uMPS = TtIimps ^^'^ '^^ introduce a map $ : T^uMPS ^ '^Imps • i-^i ^) ^ 
\^{B;A)) = \^^^^\B)) using the prescription 

d 



MB; A)) = = B' 



\^{A)) 



neZ {s„}=l 



± v! 



YlA' 



B'" 



YlA- 



\m<n 



\m'>n 



VK\{Sn}) ■ 



(142) 



Note that the tangent space T^^pg contains only translation-invariant states. However, 
we can interpret a uMPS A e ^uMps as a special point within the class of generic MPS 
Amps{d„=£>} by identifying {A{n) = >l}nez e Awpsp) = Amps{d„=d} = linez^^''''''^ ^ ^^^h 
that |^'[{A(n) = = where we heavily overload the notation . Clearly, we 

have A^uMPS C A4mps(d) — M.MPS{Dn=D}- Henceforth, we discard the notation of {D) or 
{Dn = D} in the definition of the MPS spaces. In principle, we should now take proper 
care to define the subset of injcctivc MPS ^mps in the thermodynamic limit, since we have 
only done this for a finite lattice with open boundary conditions in the previous section 
and for uniform MPS in the current section. However, we can expect that «4mps is an open 
set which includes the points {A{n) — ^}nez for any A e ^uMps- Using the identification 
A !->■ {A{n) — A}n^z, we can embed ,4umps as a subset in ^mps- In addition, with .4mps 
being an open set, it contains a neighborhood around every point {A{n) = A}nez and 
we expect T{ A(n)= A} „ez'^MPS = Amps- We denote T|*[{^(„)=A}„gz]>-^MPS as tJ^^. For any 
A e ^uMPS, we can then define a map 

: T{^(,)=^}„^,^MPS = Amps ^ T^^g : {A,B = {B{n)}nez) ^ (143) 
with the prescription 



n& {s„}=l 



Yl A'^ ) B'-{n) I Yl A'rn' 



\in<n 



\m >n 



Vr \{Sn}) ■ 



(144) 



As before, the notation of $ is heavily overloaded and the difference is indicated by the fact 
whether the argument is contained in round or square brackets. Evidently, we also have 

r^{A) rn,{A) 

■"■uMPS -"-MPS- 

As a final observation, we recall that in many problems with translation invariance. 
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Hilbert space can be decomposed into different momentum sectors. Here too, we can intro- 
duce a new set of definitions, by writing 

7{A(n)=AW^MPS = AMPs = 0C^"''"''- r A, (145) 

neZ -'pe[-7r,7r) 

where Ap ^ A^mps = C^^i^^ and we identify B e Ap witfi {B{n) = B&P^}nez e Amps- 
Analogously, we also make a momentum space decomposition of the tangent space as 

^uk = r (146) 

J P£[—tt,tt) 

For every A e ^uMps, we then define a final map ^p^^ : Ap Tp^^ : B i-^ \^p'^\B)) using 
the prescription 

1 



neZ {sn}=l 




vn\{sn}). (147) 



Note that \^i'^\B)) = |$(^)(S)) and thus tJ^^ = tJ^^ps, the set of translation-invariant 
tangent vectors. These notations are used interchangeably. 

The different representations $ of tangent vectors also have a large representation re- 
dundancy. For the principal fiber bundle \E' : ^mps ~^ A^mpsj the structure group is 
given by Smps — Gmps/GL(1,C) with Gmps — nnezGL(£', C) and the normal subgroup 
GL(l,C) C Gmps given by GL(l,C) = {{G(n) = clD}nez\c £ Co}. However, since we 
restrict to uniform elements A e ^uMps C ^mps using the embedding discussed above, 
we should only consider the invariance of under the translation-invariant action 

of the group S^mps = PGL(L',C) ^ GL(L', C)/GL(1, C). We can also embed S^mps as a 
subgroup of Smps by identifying [G] E Sumps with [{G{n) = G}nei] ^ Smps, which is inde- 
pendent of the chosen element from the coset [G]. We then obtain, for any [G] e Sumps, 
that = where the group action S(^) = {B^^\n)}nez is defined by 

{B^^^y {n) = G-'B'{n)G (148) 



and is independent of the chosen element from the coset [G] . At a fixed point {A{n) = A}ne 



z, 



the linear homomorphism ^^"^^ : Amps ~^ '^mps ^ ^^^^ space N^"^^ that is isomorphic to 
the full (translation non- invariant) group algebra 5mps, given by 

5MPS =\x = {x{n)}nez e 0MPS = 00[(i5,C) = 0c 



neZ neZ 



Etr[a;(n)] = I (149) 
nez J 
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It is now easier to decompose the group algebra into the different momentum sectors 5mps = 
f ® r s 5b with 

5p = < (150) 
I p0[(D, C) ^ 5i{D, C) = {xe C^x^l tr[a;] = 0}, p = 0. 

An element x e Sp is identified with {x{n) = xe^^}nez £ -Smps- Every Sp is isomorphic to 
the null space nf^ C Ap of the map $p using the isomorphism 

Kf^ : Sp ^ C Ap : X ^ Xj^) {x) (151) 

with (?4'^^)*(x) = A^x—e~'^PxA^ . Hence, in momentum space, the different spaces completely 
decouple and we can simply work with finite-dimensional vector spaces. For the given 
prescription of J^^\x)^ the embedding of Sp in 5mps is compatible with the embedding of 
Ap in Amps- Note also that 3\fp^Q(l£)) = 0, which is in accordance with the restriction of 
5p=o to the set of traceless matrices. 

Having defined the vertical subspaces Np"^^ of Ap, we should now introduce a principal 
connection Up^^ : Ap ^ Sp that defines a complementary horizontal subspace B^"^-* = kero^^^^ 
such that Ap = B^"^^ © Np^\ The principal connection should act as oup^^ (j^p^\x)^ — x for 
any x E Sp and transform equivariantly as Up^'' (S'^'^^) = Adc-i (^uI'^\b)^ for any B E Ap 
and any [G] e Sumps- We first consider the case p ^ 0. The virtual operators ^^^^1 — e^^^E 
have no zero eigenvalues and can thus be inverted, since E has a unique eigenvalue of 
magnitude z^^\ namely z^^^ itself. Let 9p and 9p denote the inverse of the corresponding 
maps z^^^Id — e+'^£ and z^^^Id — e~'^£. Two valid choices for a principal connection are given 

by 

^(AX)^^) = r^Sp (^^{A')UB'^ , tc;(^'^)(5) = -c+'^Jp 5-^r(A^)t j r-\ (152) 

Equivaricncc can be checked by noting that l^^^ = GHG and r^'^^ = G~^r{G~^y . Note 
that, while the transformation of / and r depends on the chosen element G from the coset 
[G] e SuMPS, the principal connections u^^'^^ and uj^^'^^ do not, nor does the normalization 
condition tr[Zr] = {l\r) — 1. The p — case requires a special treatment because the maps 
2;^^)ld — £ and z'^^hd — £ corresponding to the right and left action of the operator z'^^^l — E 
are not invertible. There is a unique eigenvalue zero with corresponding projector S = 
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However, for B = [N'p^q(x), it can easily be checked that (Z|E^|r) = 0. Hence, we can define 
a pseudo-inverse (z^^^l — E)*^^^^ with the property that 

(^(1)1 _ E)(-^)(;z«l - E) = (^^1 - E){z^^h - E)(-i) = 1 - S = Q. (153) 

The maps associated to the right and left action of (z^^^l — E)^"^^ are denoted as 3p=o and 



5p=o- With these definitions, the principal connections defined in Eq. (152) are also valid 
for p = 0. Vectors B G Mp^'^ defined by Bp'^'' = ker Wp'^''"'' satisfy 



(154) 



(/|E^ = 0^ELi(^1^^i?^ = 0, Py^O, 

(/|E^Q = ^ EUM'ViB' = [ELM'ViB'r] ^ p = ^^ 

which can be called the left gauge-fixing conditions. Vectors B G Mp^^ satisfy these conditions 
and can therefore be said to be in the left-canonical form. Similarly, vectors B G Bp"^^ 
defined by Bp"^^ = ker Up^'^^ are in the right canonical form and satisfy the right gauge-fixing 
conditions 

E^\r) = 0^J2l=iB'r{A'y = 0, p =^ 0, 

(155) 

QE^|r) = ^ 'EUiB'riA'Y = rtr ELi ^'^(^')^] ' P = ^■ 
Finally, we can return to the projective case. We can run through the same steps in order 
to define an enlarged tangent space T[|^(^))7V1mps with the uMPS [|\E'(74))] G A^uMps at its 
base. We can write T^pg = T[\^S)(a))-M.mps — r|*(A))-^MPs/ ~) where two tangent vectors 
and |$'^'^^[i?2]) are equivalent if there exists some a G C such that \<^^^\Bi]) - 
|$(^) [B2]) = a |\l'(y4)). If we now make a momentum decomposition T^pg = J^^^_^ ^-^ Tp^\ it 
is easily obtained that f^^^ = Tp"^^ for any p ^ 0, whereas Tq'^'' = T^^^pg = T[|^(^))] TWuMps — 
Tq"^^/ ~= Tq'^''"'", where we have chosen to represent the different inequivalent vectors living in 
the quotient space by the unique representative that is orthogonal to |\E'(A)). In accordance, 
we can now define a symmetry group Smps — GL(1,C) x Smps and corresponding group 
algebra Smps = /p^[_^^)5p. Since the additional GL(1,C) symmetry operations of norm and 
phase changes are translation-invariant operations, we obtain Sp = Sp for any p ^ 0, whereas 
3q = 0[(1, C) © So = C © 5o- We can define a vertical subspace Np"^^ c Ap = Aumps that is 
isomorphic to Sp using the map 

{a,x)^^'^\a;x) = J<i'^\x) + aA, p = 0. 
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A complementary horizontal subspace Mp^^ is defined as Bp"^"* = ker Wp'^^ where the principal 
connection ui,^^ : A„ — )• s„ can be defined as 



OJ. 



i"^': Ap^Sp-. < 157 



where cjp"^^ is a valid principal connection in the affine case, such as Up"^'^^ or Wp"^'^'' defined in 



Eq. (( 152[ )). The corresponding connections in the projective case are denoted as Up"^'^^ and 



Co'p^'^'' respectively. Vectors B G Bp'^'' = ker oop^'^^ now satisfy the left gauge- fixing conditions 

(/|E^ = (158) 

for any choice of p, both p ^ and p = 0. Analogously, for B G Bp^^ = kerwp^'^'' we obtain 
the right gauge-fixing conditions 

E^|r) = (159) 

for any p including p = 0. In conclusion, we now compute the overlap between any tangent 
vector |$p"^''(i?)) and the original uMPS |\l'(yl)). Henceforth, we always work in the pro- 
jective setting but with representatives |\1'(A)) G A^mps instead of the equivalence classes 
[|\l/(74))] G TWmps- However, we choose these representatives such that (\I^(y4)|\&(yl)) = 1 
whenever we are computing with |\E'(A)) or Put differently, we always act with an 

element of the GL(1, C) subgroup of Sumps so as to have a representation A G ^uMps in the 
fiber corresponding to [|\1'(A))] G A^uMps for which z^^^ = p(E) = 1. Correspondingly, we 
also obtain QEQ = E — S. Based on the definition of the subset ^uMps of injective MPS, we 
then have p(QEQ) < 1 for the chosen representations A. Under this condition, the overlap 
between any uMPS |^(A)) and |$^^^(5)) is given by 

{nmi,''\B)) = 5^e^^"(/|E^|r) = 27r5(p)(/|E^|r) (160) 

riGZ 

SO that all states \^p{B)) with p ^ are automatically orthogonal to |\E'(A)) due to the 
orthogonality of the different momentum sectors. At momentum p = 0, we observe that 
for B G Bq'^'' defined by either the left or right principal connection iOQ^\ we also obtain 
{'^{A)\^1^\b)) = 0, in correspondence with our expectation Tq^^ = Tq"^^"*". For the choice 
B = A, which is in B^^^ but not in we obtain (^(]4)|$5,^^(5)) = 27r5(0) = |Z|, where 

the cardinality |Z| represents the diverging number of lattice sites (£ = Z). This explains 
why we work within the projective setting throughout the remainder of this section. 
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D. Fullback metric and efficient parametrization 

Once again, we have come to the point where we can induce the Fubini-Study metric 
from P{M) onto A^uMps in order to transform it into a Kahler manifold, and then define 
a puUback metric g on «4umps- As just mentioned, we now exclusively treat the projective 
setting. Nevertheless, we do also compute the puUback g of the natural metric of affine 
Hilbert space, since it features in the computation of g and it provides further justification 
for the restriction to the projective setting. 

The puUback metric g{p, p'; A, A) is imphcitly defined by (B)\^lf^ {B')). Henceforth, 
we discard again the explicit notation of the base point (A) at which we are working, since 
this is fixed throughout the remainder of this subsection. We have to be very careful with 
the infinite sums over the positions n e Z and n' e Z oi B and B'. When a diverging result 
is obtained, it is easily possible to make errors by miscounting. Only when the result is 
guaranteed to be finite can we freely use index substitutions. We therefore replace every 
occurrence of E" by a 'regularized' operator QE'^Q = E'^Q = QE" = E" - S = Q(QEQ)"Q 
with p(QEQ) < 1 and a 'singular' part S = |r)(Z|. The reason of this notation becomes clear 
if we now evaluate ($p(S)|$p/(S')) as 



{^,iB)\^,,{B'))=B'g,jip,p')B'' 

^(n = n')(/|Ef |r) 



+00 +00 

. ^ ^ g+ip'n'-ipn or, ^'\/l\lt?B'\ 

n=—oo n'=— 00 



+9{n' > n)(Z|E^(E)"'-"-iEf |r) + < n)(Z|Ef'(E)"-"'-i£;^|r)l 



+00 +00 

no=— 00 An=— 00 

+e{An > 0)(Z|E^QE^"-^QEf |r) + ^(An < 0)(Z|Ef QE-^"-^QE^|r) 

+00 n— 1 +00 +00 

+ mi\r){l\E^\r) J2 E e'^'"'-'^'^ + (/|Ef|r)(Z|E^|r) e^^''^'-^". 

n=— 00 n'=— 00 n=— 00 n'=n+l 

In this calculation, we have introduced a 'discrete' Heaviside function 6 taking a logical 
expression as argument and resulting 1 if the argument is true and zero otherwise. By using 
the well known result for the geometric series of an operator with spectral radius smaller 
than one, we obtain 

+ CXD +00 

QE"Q = Q(QEQ)"Q = Q(i - QEQ)-iQ (161) 

n=0 n=0 
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and thus 

=2tt6{p'-p) [(/|E|'|r) + (/|E^Q(1 - e'^'QEQ)-iQEf |r) 

+ (Z|Ef Q(l -e-^PQEQ)-^QE^|r) - (/|E^'|r)(/|E^|r) 



(162) 



+ [2n6ip)rmA\r)mB\r 



As expected, momentum eigenstates cannot be normalized to unity in an infinitely large 
system, but rather satisfy a 6 normalization. However, for momentum p = 0, we have 



an additional diverging contribution which is much stronger. By using Eq. (160), it can 
be traced back to the diverging overlap of |$p(i?)) with |\E'(y4)). Let us now analyze the 
origin of the different terms in the expression above. The regular part QEQ produces a 
finite contribution inside the square brackets where B and B' cannot be separated into 
different factors. We therefore also refer to these terms as the connected contribution. For 
p = 0, the product Q(l — e^'^QEQ)~^Q can be interpreted as the pseudo-inverse (1 — E)^"^) 
of the singular superoperator 1 — E, which we have already encountered in the previous 



subsection and was defined in Eq. (153). We now extend this definition and henceforth 
define (1 - e^'PE)^-^) = Q(l - e±iPQEQ)-^Q, so that (1 - E)(-i)(l - E) = {t-e^'PE){l - 
giipjE^-i) — Q — 2 — |r)(/|. Only for momentum p = does (1 — e^'^E)'^^^^ denote a true 
pseudo-inverse. The singular part S produces a finite contribution in the square brackets 
for any momentum, and the doubly diverging contribution at momentum p = 0. In these 
terms, B and B' appear in two separate factors, and they are henceforth referred to as the 
disconnected contribution. Since the doubly diverging term results from the non-zero overlap 
with the original uMPS, it disappears for tangent vectors in Tq'^''"'". 

Clearly, this hints that we should work in the projective setting. Since the pullback of 
the Fubini-Study metric is implicitly defined by 

where we use the convention to choose A such that (\E'(A)|\I'(A)) = 1, we obtain 

B'~g,,,{p,p')B'' =27i6{p - p'0~g,^,{p)B" 

=2n5ip'-p) [(/|E|'|r) + (/|E^(1 - e'PE)(-i)Ef |r) (164) 



+ (/|Ef (1 -e-^^'E)(-i)QE 



\K\r) 
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Up to the unavoidable diverging 5 normalization, we now obtain a strictly finite contribu- 
tion that is henceforth denoted as g-ij{p), so that gij{p,p') = 27t6{p — p')gtj{p). The doubly 
diverging contribution has been cancelled automatically. It can easily be checked that the 
contraction of either index of the metric g{p) with any vector B G Np, including the choice 
B = A for momentum p = 0, results in zero. We can thus restrict to vectors B in the hori- 



zontal subspace Bp by imposing either the left or right gauge fixing conditions in Eq. ( 158 ) 



or (159). This considerably simplifies the expression for the metric g{p), since the non-local 



connected terms and the disconnected term cancel, resulting in 

B'~g,,ip)B'^ = il\E^'\r). (165) 
As before, we define a pseudo-inverse metric satisfying 

~9'''{pr9jAp) = {Pm,)\ = ^1- {Piy)\ (166) 
and the projector Pf^^ E L(Ap) onto the vertical subspace Np C Ap is defined by 

{Pf,^)\B' = W^{up{B)). (167) 

The pseudo-inverse g^'^{p) is defined within a single momentum sector. We can extend it as 
g^'^PiP') = 27i6{p — p')g^'^{p) in order to obtain 

j "^-g'-^p.p'Ya-Ap' y) = 2vr5(p - /) {Pn}j\ ■ (168) 
Finally, we need to discuss how to efficiently parameterize the tensors B that satisfy 



the left or right gauge fixing conditions in Eq. (158) or (159). A linear parameterization 
B = Sp(X) depending on a (g — 1)D x D matrix X can be constructed, analogously to 
the construction in the previous section, but now in a translation invariant setting. We first 
define the D x Dq matrices L as 

[LUs,p) = [A'U'%,p (169) 

and then construct a, D x [q — 1)D matrix Vl that contains an orthonormal basis for the 
null space of L, i.e. LVl = and V^Vl = l(g-i)z). Setting [V2]q:,/3 = [Vl](sq,);^), we then 
define the representation Sp(X) as 

3p(X) = (170) 
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in order to obtain 

($p(Sp(X))|<|.p,(Sp,(F))) = 2n5ip~p')ti [Xty] , (171) 

in combination with the left gauge fixing condition Yll=i ^^^/^^(X) = 0. The representation 
Sp(X') mapping the D x [q — 1)D matrix X' to a tensor B satisfying the right gauge fixing 
conditions follows similarly. 



E. Levi-Civita connection and parallel transport 

We have characterized A^uMps as a Kahler manifold and defined the Kahler metric gij. 
So far, we have been using a description based on the parameterization of A^uMps via tensors 
A G ^uMPS- This parameterization is overcomplete, and the A^'s cannot be used as a set of 
coordinates for A^uMps- As a consequence, the metric g^j is not a proper metric, since it is 
degenerate. 

The most rigorous way to proceed is by introducing a coordinate transform ^ A'^{z, w) 
for ^uMPS, where the new coordinates (j = 1, . . . , (g — 1)-D^) and {k = 1, . . . , D^) are 
such that d/dz^ G Bumps and d/dw^ G Numps- Hence, the coordinates w are related to 
gauge and scale transformations, whereas the coordinates z label the different gauge orbits. 
They arise as the natural coordinates for the quotient manifold ^uMps/SuMps, or thus, for the 
manifold A^uMps- When expressed solely in terms of the coordinates z, the pullback metric 
would be strictly positive. Since we presently restrict to the representation of uniform MPS, 
the horizontal and vertical subspace correspond to those defined in the previous subsection 
at momentum zero: Bumps = Bp=o and Numps = ^p=o- Note that these spaces also depend 
on the current position A{z,w). The required properties for a principal bundle connection 
by which these spaces are defined, ensures that such a coordinate transformation exists. 
While it is quite easy to find an explicit parameterization for the gauge degrees of freedom, 
it is more difficult to find an explicit coordinization for the gauge orbits. 

Therefore, we continue with the parameterization of AIuMps based on the original ten- 
sors A G ^uMPS, and take into account that this set is overcomplete. A first consequence 
thereof has already been observed in the previous subsection: the pullback metric gij is 
degenerate and we need to take a pseudo-inverse to define the entries We now proceed 



by constructing the Levi-Civita connection according to Eq. (41). Hereto, we introduce the 
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states 



\T{B,,B,;A)) = \T^^\B^,B,)) = BlBi—— \^{A)) = B{Bi \d,dMA)) 



ni<n2eZ {s„}=l 
n2<n\& {s„}=l 



dAidAi 



'vm<ni 



\ni<m<n2 



\m'>n 



\m<n2 



\n2<m<ni 



\m'>n 



VK\{Sn]) 

VK\{Sn}) ■ 

(172) 



We can generalize this definition to obtain arbitrary momentum eigenstates \ Tp^^p^[Bi, B21A)) 
with momentum (pi + P2) mod 27r by adding a factor exp(ipini + ip2n2) to every term in 
the definition above. While we restrict to pi = p2 = throughout the remainder of this 
section, the inclusion of momentum factors facilitates keeping track of the different terms 
in the following expressions. We can easily compute the overlap 



{^{A)\Tp,,p,{B^,B2;A)) ^ 27r5(pi +P2) 



X 



+ (27r5(pi)-l)(/|E^^|r)(/K^|r 



(173) 
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and with a httle bit more algebra 

{%,(Bs;A) I Tp,,p,{B,,B2;A)) = 27r5(pi +P2 -Ps) 

x|e+'Pi(/|Eg(l - e+'^'iE)(-^)E^» +e-'fi(Z|E^i(l - e-'PiE)(-^)Eg|r) 

+ e+'P^{l\E^l{l - e+'^'2E)(-^)E^^|r) + e-'P'{l\Ef{l - e-'^^^Ej^-^^E^^Ir) 

+ e+'P^+^'P'{l\Ei^{l - e'P'+'P'E)-^Ef{l - e'P'E)-^Ef\r) 
+ e-'P^-^'P'(l\E^'(t - e-'P'E)-^E^^(l - e-'P^-'P^Ey^E^Jr) 
+ e-'P'+'P%l\Ef{l - e-'P'Ey^Ei^il - e+'^'Ey^E'^^lr) 
+ e-'P'+'P'{l\Ef{l - e-'f2E)-^E;^3(l - e+'^'iE)-^E;^» 

- {l\Ef\r) [{l\E^l\r)+e+'P'{l\Ei^{l-e+'P'E)^-^^Ef\r)+e-'P'{l\^^^ 
_ e+'P^+'P'{l\E^'\r){l\Ei^{l - c+'^'^E)(-^)(l - e+'P'+'^m^-^^Eflr) 

- e-'P'-'P%l\E^'\r){l\Ef{l - e-'P^E)^-^\l - e-'P'-'Pm)^-^^E^Jr) 

- {l\Ef\r) [(Z|E^i|r) +e+'^'i(Z|E;^3(l -e+^*'iE)(-^)E^i|r) +e-'^'^(Z|E^i(l -e-^^^E)(-^^E;^3|r)] 

- e+'*'i+'*'2(/|E^^|r)(/|E4(l - e+'P'EY-^\l - e+'P'+'P'EY~^^Ef\r) 

- e-'P'-'P\l\Ef\r){l\E^'{l - e-'P'E)^-^\l - e-'P'-'Prn^-^^E^Jr) 

- {l\Eijr) [e+'^'^(Z|E;^^(l - e+^P^E)(-^)E;^^|r) + e+'P'{l\Ef{l - e+'^'iE)(-^)E^»] 

- e"'P^(/|E^3|r)(/|E^^(l - c+'piE)(-^'(1 - c-'f''EY-^^E^'\r) 

- e-'P'{l\Eijr){l\Ef{l - e+'^'2E)(-^)(l - e-^^^Ej^-^^E^^Ir) 
+ 2{l\E^^\r){l\Ef\r){l\El\r) 

+ 27r5(pi)(;|E^»[(/|Eg|r) +e+'f2(/|E;^3(l -e+'f2E)(-^)E^2|r) 

+ e-^^^(Z|E^^(l -e-'^^E)(-^)E4|r) - {l\E2'\r){l\El\r)] 

+ 2n5(p,)(l\E^/\r) [(Z|E^^|r) + e+'^n^K(l - e+^^^E)(-i)E^» 

+ e-^^n/|E^Hl -e-^^^E)(-%4|r) - {l\E2^\r){l\E^Jr)] 

+ 27r5(pi + p2){l\Eijr) [e+^^'^(/|E^^(l - e+'^^E)(-i)E^^|r) 

+ e+'P'{l\Ef{l-e+'P'E)^-'^E^'\r) - (l\E^'\r)(l\E^'\r)] 

+ (27r)25(p05(P2)(/|^f»(/|^^1r)(/|E4|r)| 

(174) 
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Since this subsection is concerned with the translation invariant manifold A^uMPS, we restrict 
to the momentum zero states Pi = P2 = P3 = 0. Clearly, then, the expressions above have 
a diverging prefactor 27r(5(0) = |Z| corresponding to the infinite number of sites. This is 
compensated by an factor |Z|^^ in the pseudo-inverse metric g'^"^ featuring in the definition 



of ^ij'- However, Eq. (174) also contains additional divergences on the last four lines within 



the square brackets, resulting from the disconnected contributions of the transfer matrix. 



These divergences are precisely cancelled by the other terms in Eq. (42) resulting in a well- 
defined and finite Levi-Civita connection for the manifold A^uMps- 



Many other terms in Eq. (174) can be eliminated by using -B^'s {k = 1,2,3) that live 
within the horizontal space Bumps = Bo defined by the left or right gauge fixing conditions 



in Eq. (158) or (159). However, since the Levi-Civita connection is not a proper tensor, we 



do not expect it to be invariant under gauge transformations B[ = Bk + 3\fo(«fc, a;^). Put 
differently, the linear map Aumps ~^ H obtained by fixing either Bi or B2 in the definition 
of |T(i?i, i?2; ^)) does not have Nq as kernel. For example, it can easily be checked that 

|T(5i,A;A))= [27r5(0)-l] 

By introducing an infinitesimal gauge transformation G = exp(ex) in 
\^{B; A)), we also obtain 

|T(5,K(^)(a;);A) = - A)) . 

Hence, under a gauge transformation B2 = B2 + !N(a, x), we obtain 

|T(i?i, B',; A)) = |T(i?i, B2; A)) - «(27r5(0) - 1) A)) - A) . (175) 

Note that the additional contributions are contained within the tangent space T|,i,(^))A^uMps- 
Having a Levi-Civita connection at hand, we can now introduce a covariant derivative 
Vj, and use this to define the space of first and second order derivatives properly. Acting 
with V,- a first time on a scalar function 



0{A,A) 



{^{A)\d\^{A)) 



{^iA)\^iA)) 

on A^uMPS, allows one to recognize the orthogonal complement of the standard tangent 



vectors 



\^'{B;A)) 



Po{A,A) MB; A)) 



(176) 
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Here we have introduced the projector onto the uMPS as 

{*(^)i*(A)> 

Acting on ViO{A,A) = diO{A,A) a second time with Vj, results in 

V, V,0(A, A) = d,d,d(A, A) - f ,/9fcO(A A) 
from which we can infer the following covariant definition for double tangent vectors 



(177) 



\r{B^,B2;A)) 



PoiAA) 



^(A)mB2;A)) 



\TiB^,B2■,A))-\^B^■,A)) 



{^if{A)MBi;A)) 

mA)\^{A)) J 

We have now also introduced the projector onto the tangent space 



(178) 



mB2;A)) 



^|*{A))-'^uMPS 



(A A) = \dk^{A))~g'"'{A,A) {d^nA)\. 



(179) 



If Bi and B2 are such that (^(A)|<l>(5i; A)) = (^(v4)|$(52; A)) = 0, then the states 
\T'{Bi, B2; A)) are equal to that part of \T{Bi, B2; A)) that is orthogonal to both the 



original uMPS |^(A)) and all of its tangent vectors. Eq. (175) illustrates that the states 



\T'{Bi, B2; A) are invariant under gauge transformations of the B^s {k = 1,2), i.e. the 
linear maps obtained by fixing either Bi or B2 have the vertical subspace Numps as kernel. 



F. Riemann curvature tensor, Ricci tensor and scalar curvature 

To complete the Riemannian description of the manifold A^uMPS C EI or A^uMPS C -P(IHI), 
we now also compute the Riemann curvature tensor and its derivates. It can be shown that 



Eq. (45) results in 



B^B^B^B^^K-j^l = 



{^'{B2; A)\^'{B,; A)) {^'{B,; A)\^'{B,; A)) 

— 2 (loU) 

{^{A)mA)f _ 

{^'{B2; A)\^'{B,; A)) {^'{B,; A)\^'{B,; A)) 

mA)mA)f 
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Given the remarks at the end of the previous subsection, the Riemann tensor -R^^^ is gauge- 
invariant. An exphcit expression of the equation above is given in Appendix |B| but only for 



-Bfc's {k = 1, ... ,4) satisfying the left gauge fixing condition Eq. (158), which allows us to 
cancel many terms. 

From the Riemann curvature tensor we can also define the Ricci tensor as 

rTcj = R% = fk^^ = -d.dj\ogdet[g]. (181) 

One also defines the Ricci form as 



n = i Ric0 dz' A dz, (182) 

which is a real and closed two-form, whose cohomology class corresponds — up to a constant 
factor — to the first Chern class of the canonical line bundld^. 

Finally, the scalar curvature is obtained by also contracting the Ricci tensor, resulting in 

S = fmcrj = f'f'Rrjki- (183) 

The physical significance of the curvature of a variational manifold in relation to the ap- 
proximation error made by reducing a state in Hilbert space to the manifold was discussed 
in great detail by Sidles et al.^, and we refer to this publication for more information. 



V. SUMMARY AND OUTLOOK 

This article presents a thorough discussion of the mathematical structure of the MPS 
representation of states in either affine or projective Hilbert space using the language of 
fiber bundles and complex geometry. We discussed both generic MPS on finite chains with 
open boundary conditions and translation invariant MPS on chains with periodic boundary 
conditions or in the thermodynamic limit. 

By restricting to the so-called subset of full rank MPS (open boundary conditions) or 
injective MPS (periodic boundary conditions), we were able to identify this representation 
with a principal fiber bundle. The variational parameters live in the bundle space. The phys- 
ical states encoded by the variational parameters are left invariant under a well-understood 
set of gauge transformations and should therefore be identified with points in the base space, 
i.e. the quotient space of the bundle space and the structure group (gauge group). This 
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identification is bijective, and standard theorems of fiber bundle literature automatically 
imply that the set of MPS can therefore be given the structure of a (complex) manifold. 
Since this manifold is embedded in an affine or projective Hilbert space, which is a Kahler 
manifold, the manifold of MPS is also a Kahler manifold. The corresponding Kahler metric 
can be obtained by inducing the standard metric of Hilbert space. 

A major part of this paper has focussed on the tangent space to the manifold of MPS. 
This linear subspace of Hilbert space has recently been proven interesting in both the study 
of time-evolutioii^ and as a variational ansatz of elementary excitation j^° * ^^ l The gauge 
invariance of the MPS representation implies that not all partial derivatives with respect 
to the variational parameters produce linearly independent tangent states of the manifold. 
Within the fiber bundle context, the tangent map from the tangent bundle of parameter 
space to the tangent bundle of the base manifold has a non-trivial kernel that is referred to as 
the vertical subspace. A unique representation of tangent vectors requires the introduction of 
a principal bundle connection, which defines a complementary horizontal subspace. This can 
be understood as a canonical representation for MPS tangent vectors, where the connection 
acts as a gauge fixing prescription. It can be constructed in such a way that many physical 
expectation values involving the tangent states simplify tremendously. In particular, for 
every given base point, there exist at least two canonical representations that transform the 
metric at that point into the unit matrix. While this gauge fixing prescription had already 
been constructed in previous paper^^^'^, we have now shown that it satisfies the required 
criteria for being a principal bundle connection, so that it transforms equivariantly under 
gauge transformations. 

Given the physical relevance of the MPS tangent space, its rigorous constructions helps 
to identify where the naive description breaks down. Non-injective MPS correspond to 
singular points of the variational set and require a special treatment. However, it is quite 
trivial to generalize the present construction to the case of G-injective MP^^, which will 
have a smaller structure group given by the quotient group PGL(D,C)/G. We also expect 
that our construction trivially generalizes to the set of tree tensor network^, and possibly 
to the set of injective or G-injective projected entangled pair stated33. 

Aside from the already established applications in studying time-evolution and excita- 
tions, we believe that the concepts developed in this paper constitute a basis for many 
additional developments. For example, it has already been understood that the properties 
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of the structure group PGL(D,C) are relevant in the classification of possible phases that 
gapped quantum systems can exhibilP^'^. A further study of the topological properties of 
either the structure group or the manifold itself might unveil additional information. On 
a more general level, by using the rules of geometric quantum mechanic d^ * ^ * ^^ ^, a complete 
theory of quantum mechanics can be formulated in which the usual projective Hilbert space 
is replaced by the smaller manifold of MPS. The Kahler structure of the manifold gives 
rise to an invariant volume measure that can be used in order to describe mixed states as 
probability measures over the manifold of MPS. On the more practical side, it has been 
understood that standard optimization methods such as conjugate gradient or Newton's 
method benefit greatly from taking geometrical properties of the underlying search space 
into account^, by replacing ordinary derivatives by covariant derivatives and line searches 
by searches along geodesic. Clearly, the Levi-Civita connection and the notion of parallel 
transport play a major role in this development. Applying these methods to the manifold 
•^{u)MPS might result in new algorithms for finding ground states whose efficiency is less 
susceptible to the magnitude of the gap in the system. 
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Appendix A: Graphical notation 

The tensor network community has grown accustomed to using a graphical notation to 
represent tensor networks and visualize tensor identities that need to be imposed or are 
automatically satisfied. Any shape can in principle be used to represent a tensor. The 
tensor indices are represented by wires that can range over their respective values. When 
two wires exiting from two different tensors are connected, this corresponds to a contraction 
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FIG. 3. Graphical illustration of the basic definitions involving a uniform MPS: (a) the elementary 
tensor A G Aumps that forms the basic building block of the uMPS; (b) definition of the transfer 
matrix E obtained by contracting A and its complex conjugate along the physical index; (c,d) 
eigenvalue equation for the left (c) and right (d) density matrices / and r under the assumption 
that A is properly normalized such that E has largest eigenvalue 1. 



of the corresponding indices. 

We now illustrate that such a graphical representation is also very natural in the context 
of MPS tangent vectors. FIG. [sj^a) represents a basic tensor A that could be an element 
of A 

uMPS and would then feature in the definition of a uniform MPS. The bottom wire 
corresponds to the physical indices, whereas the left and right wires correspond to the row 
and column indices of the matrix A* for a given value s = 1, . . . , g of the physical index. 
FIG. |3|^b) represents the definition of the transfer matrix E = Y11=i ® corresponding 
to a contraction of the physical index. Note that complex conjugation is not explicitly 
denoted in the graphical representation, but is implied by mirroring the tensor A so as to 
have the physical index as an upper wire. Assuming that A is properly normalized such 
that the largest eigenvalue of the transfer operator E is 1, we can graphically denote the 
eigenvalue equation for the left and right eigenvectors (/| and |r) corresponding to Hermitian 
matrices / and r as in FIG. [sj^c) andjsj^d). 

This graphical notation is particularly convenient to define e.g. the left canonical form for 
the tensor B used in the representation of tangent vectors |$p(i?)), as is shown in FIG. [4j In 
addition, we can expand full expectation values such as the (squared) norm 
in terms of these diagrams, as in FIG. |5| and easily infer how this expression simplifies by 
using the defining equations of the tensor Vl in FIG. |4](b) and|4|^c). 
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FIG. 4. Graphical representation of the left canonical form for the parameterization of tangent 



vectors to the manifold of uniform MPS B = !Bp(x) according to Eq. (170) (a), where the tensor 
Vl is determined by the equations denoted in (b) and (c). 
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FIG. 5. Graphical representation of the norm of a tangent vector \^p(B)) [up to the diverging 
factor 27r5(0)] and its simplification after the left canonical form of FIG. [4] has been inserted. 



Appendix B: The Riemann curvature tensor 



The Riemann curvature tensor of the manifold of (projective) uniform MPS at a point 



'^{A)) was given in the main text in Eq. ( 180 ), using the covariantly defined states \ ^'{B; A)) 



and \T'{Bi, B2; A)) . Its full expression contains many terms, most of which are to ensure 
that R^;^i^j acts as a proper gauge-invariant tensor, so that it is zero whenever one of the 
indices is contracted with an element of the vertical subspace Numps- If we restrict to 
contraction with elements Bi, B2, B^ and i?4 within the horizontal subspace defined by 



either the left or right gauge fixing conditions [Eq. (158) and Eq. (159) respectively], then 
many of these terms cancel automatically. If for example the left gauge fixing conditions are 
satisfied, the resulting tensor elements are shown in FIG. [6] The state |T'(i?i, i?2)) contains 
the ordinary second derivative \T{Bi,B2)) minus its projection its projection onto the first 
tangent space. The former produces the first six lines, whereas the latter corresponds to 



75 



Geometry of Matrix Product States 



R-^ R^' f? 



(r) + [l 



■l-E)P 




1-E)P 



^3 



(rl + [i 




{BA 




(l-E)f 




(1 





(l-E)f 




(1 





(1- 




(l-E)f 





1-E)P 




1 -E)P 



r ) + ( / 



r ) + (/ 




(l-E)f 




(1 -E)f 





(l-E)f 




1 -E)P 





(1 




(l-E)f 





1-Ef 




(l-E)f 





FIG. 6. Graphical representation of the Riemann curvature tensor R^^^j^j when contracted with 



vectors B G Bumps satisfying the left gauge fixing condition of Eq. (158) 



lines number 7 and 8, and is formulated using the tensor Vl which was defined graphically 
in the previous appendix. The last line corresponds to the disconnected contributions to the 
Riemann curvature tensor. 

76 



Geometry of Matrix Product States 



REFERENCES 

^Absil, P.-A., Mahony, R., and Sepulchre, R., Optimization Algorithms on Matrix Manifolds 

(Princeton University Press, 2009). 
^Affleck, I., Kennedy, T., Lieb, E. H., and Tasaki, H., Physical Review Letters 59, 799 

(1987). 

^Affleck, I., Kennedy, T., Lieb, E. H., and Tasaki, H., Communications in Mathematical 
Physics 115, 477 (1988). 



4 Anderson, P. W., [Physical Review Letters 18, 1049 (1967) 
^Arrighi, P. and Patricot, C, Annals of Physics 311, 26 



^Ashtekar, A. and Schilling, T. A., (1997), |arXiv:gr-qc/ 9706069] 



^Baxter, R. J., | Journal of Mathematical Physics 9, 650 (1968) 



^Bhatia, R., Matrix Analysis (Springer, 1996). 

^Brody, D. C. and Hughston, L. P., Journal of Geometry and Physics 38, 19 (2001) 



arXiv:quant-ph/9906086. 



lichen, X., Gu, Z.-C., and Wen, X.-G., Physical Review B 83, 035107 (2011), 
larXiv: 1008:37451 



^^Choi, M.-D., |LinearAlgebra and its Applications 10, 285 (1975) 

^^Daley, A. J., Kollath, C., SchoUwock, U., and Vidal, G., Journal of Statistical Mechanics: 



Theory and Experiment 4, 5 (2004), larXiv:cond-mat/0403313 
^^Duistermaat, J. J. and Kolk, J. A. C., Lie Groups (Springer, 2004). 

^^Fannes, M., Nachtergaele, B., and Werner, R. F., Journal of Physics A Mathematical 
General 24 (1991). 

^^Fannes, M., Nachtergaele, B., and Werner, R. F., Communications in Mathematical 

Physics 144, 443 (1992). 
^^Fritzsche, K. and Grauert, H., From Holomorphic Functions to Complex Manifolds 

(Springer, 2002). 

"^'''Giachetta, G., Mangiarotti, L., and Sardanashvily, G., Geometric Formulation of Classical 
and Quantum Mechanics (World Scientific, 2011). 

Hackbusch, W. and Kiihn, S., Journal of Fourier Analysis and Applications 15, 706 (2009)] 
10.1007/s00041-009-9094-9. 



18 



77 



Geometry of Matrix Product States 



^^Haegeman, J., Cirac, J. I., Osborne, T. J., Pizorn, I., Verschelde, H., and Verstraete, F., 
Physical Review Letters 107, 070601 (2011), [a^v: 1103.0936 



20 



Haegeman, J., Pirvu, B., Weir, D. J., Cirac, J. I., Osborne, T. J., Verschelde, H., and 



Verstraete, F., [Physical Review B 857100408 (2012)j |arXiv: 1103.2286 
^iRoltz, S., Rohwedder, T., and Schneider, R. , [Numerische Mathematik 120, 701 (2012) 
^^Huybrechts, D., Complex Geometry: An Introduction (Springer, 2004). 



^^Jamiolkowski, A., Reports on Mathematical Physics 3, 275 (1972) 
^^Kato, T., Perturbation Theory for Linear Operators (Springer, 1995). 
^^Kaup, W., Inventiones Mathematicae 3, 43 (1967) 

^^Kliimper, A., Schadschneider, A., and Zittartz, J., Journal of Physics A: Mathematical 



and General 24, L955 (1991)] 



^'^Kliimper, A., Schadschneider, A., and Zittartz, J., |Zeitschrift fiir Physik B 87, 281 (1992) 
^^Kobayaschi, S., Annali di Matematica Pura ed Applicata 43, 119 (1957) 



^^Kramers, H. A. and Wannier, G. H., Physical Review 60, 263 (1941) 
3°Landsberg, J. M., Qi, Y., and Ye, K., ArXiv e-prints (2011), |arXiviTi05.4449| 

^^Lee, J. M., Introduction to Smooth Manifolds (Springer, 2002). 

^^Moroianu, A., Lectures on Kdhler Geometry, London Mathematical Society Student Texts 

(Cambridge University Press, 2007). 
33Murg, v., Verstraete, F., and Cirac, J. L, Physical Review A 75, 033605 (2007), 

[arXiv: cond-mat /061 1522 



^^Nakahara, M., Geometry, Topology and Physics, 2nd ed. (Taylor and Francis, 2003). 
^^Nielsen, M. A., Quantum Computation and Quantum Information (Cambridge University 

Press, 2004). 
^^J. Haegeman et ai, in preparation. 

^''It is important that this representation is linear in order to preserve the vector space 
structure of the tangent space. 



^^Osborne, T. J., Physical Review Letters 97, 157202 (2006), arXiv:quant-ph/0508031 



^^Oseledets, L V. and Tyrtyshnikov, E. E., |SIAM J. Sci. Comput. 31, 3744 (2009) 
"^"Ostlund, S. and Rommer, S., Physical Review Letters 75, 3537 (1995), 



arXiv:cond- 



mat/9503107 



^^Perez-Garcia, D., Verstraete, F., Wolf, M. M., and Cirac, J. I., (2006), arXiv:quant- 
|ph/0608197l 



78 



Geometry of Matrix Product States 



42 



Perez-Garcia, D., Wolf, M. M., Sanz, M., Verstraete, F., and Cirac, J. I., Physical Review 



Letters 100, 167202 (2008), arXiv:0802.0447 



^^Pirvu, B., Haegeman, J., and Verstraete, F., Physical Review B 85, 035130 (2012) 
larXiv: 1103373 51, 

^^Roman, S., Advanced Linear Algebra, 2"*^ ed.. Graduate Texts in Mathematics (Springer, 
2005). 



^^Rommer, S. and Ostlund, S., Physical Review B 55, 2164 (1997), arXiv:cond-mat /9606213| 



^''Schollwock, U., Annals of Physics 326, 96 (2011), |arXiv:1008.3477 



^^Schuch, N., Cirac, I., and Perez-Garcia, D., Annals of Physics 325, 2153 (2010), 
EFXiv : 1001.3807! 



^^Schuch, N., Perez-Garcia, D., and Cirac, I., [Physical Review B 84, 165139 (2011) 
larXiv: 1010:37321 

^^Shi, Y.-Y., Duan, L.-M., and Vidal, G., Physical Review A 74, 022320 (2006), 



arXiv:quant-ph/0511070 



^^Sidles, J. A., Garbini, J. L., Harrell, L. E., Hero, A. O., Jacky, J. P., Malcomb, J. R., 
Norman, A. G., and Wilhamson, A. M., [New Journal of Physics~ll, 065002 (2009)] 
larXiv:0805J84l 



^^Sudarshan, E. C, Mathews, P. M., and Rau, J., [Physical Review 121, 920 (1961) 
^^Uschmajew, A. and Vandereycken, B., preprint (2012) 



s^Verstraete, F. and Cirac, J. I., (2004), arXiv:cond-mat/0407066 



Verstraete, F., Garcia- RipoU, J. J., and Cirac, J. I., Physical Review Letters 93, 207204 
(2004), [arXiv: cond-iEat70406426] 

Verstraete, F., Murg, V., and Cirac, J. I., Advances in Physics 57, 143 (2008), 
larXiv: 0907:27961 

^''Verstraete, F., Porras, D., and Cirac, J. I., Physical Review Letters 93, 227205 (2004), 



arXiv:cond-mat/0404706 



57 

58 



Vidal, G., Physical Review Letters 91, 147902 (2003), [arXiv:quant-ph/ 0301063| 
Vidal, G., Physical Review Letters 93, 040502 (2004), [arXiv:quant-ph/0310089l 



^^Vidal, G., Physical Review Letters 98, 070201 (2007), [arXiv:cond-mat/0605597 
6° Vidal, G., Physical Review Letters 99, 220405 (2007), [arXiv:cond-mat/0512165 
^^Vidal, G., Physical Review Letters 101, 110501 (2008), larXiv:quant-ph/0610099 
^^White, S. R., Physical Review Letters 69, 2863 (1992). 



79 



Geometry of Matrix Product States 



^^White, S. R., Physical Review B 48, 10345 (1993). 

^^White, S. R. and Feiguin, A. E., Physical Review Letters 93, 076401 (2004), |arXiv:cond- 



mat/0403310., 



^^Zwolak, M. and Vidal, G., Physical Review Letters 93, 207205 (2004), |arXiv:cond- 
mat/0406440 



80 



